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Chapter 1 

Signals and Systems in Communications 

1.1 Signals 

1.1.1 Signal Classifications and Properties 1 

1.1.1.1 Introduction 

This module will begin our study of signals and systems by laying out some of the fundamentals of signal clas- 
sification. It is essentially an introduction to the important definitions and properties that are fundamental 
to the discussion of signals and systems, with a brief discussion of each. 

1.1.1.2 Classifications of Signals 

1.1.1.2.1 Continuous-Time vs. Discrete-Time 

As the names suggest, this classification is determined by whether or not the time axis is discrete (countable) 
or continuous (Figure 1.1). A continuous-time signal will contain a value for all real numbers along the 
time axis. In contrast to this, a discrete-time signal (Section 1.1.6), often created by sampling a continuous 
signal, will only have values at equally spaced intervals along the time axis. 
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or discrete 



Figure 1.1 



1 This content is available online at <http://cnx.Org/content/ml0057/2.21/>. 
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1.1.1.2.2 Analog vs. Digital 



The difference between analog and digital is similar to the difference between continuous-time and discrete- 
time. However, in this case the difference involves the values of the function. Analog corresponds to a 
continuous set of possible function values, while digital corresponds to a discrete set of possible function 
values. An common example of a digital signal is a binary sequence, where the values of the function can 
only be one or zero. 
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Figure 1.2 



1.1.1.2.3 Periodic vs. Aperiodic 

Periodic signals 2 repeat with some period T, while aperiodic, or nonperiodic, signals do not (Figure 1.3). 
We can define a periodic function through the following mathematical expression, where t can be any number 
and T is a positive constant: 

f(t) = f(T + t) (1.1) 

The fundamental period of our function, / (t), is the smallest value of T that the still allows (1.1) to be 
true. 



"Continuous Time Periodic Signals" <http://cnx.org/content/ml0744/latest/> 
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Figure 1.3: (a) A periodic signal with period Tb (b) An aperiodic signal 



1.1.1.2.4 Finite vs. Infinite Length 

As the name implies, signals can be characterized as to whether they have a finite or infinite length set of 
values. Most finite length signals are used when dealing with discrete-time signals or a given sequence of 
values. Mathematically speaking, / (£) is a finite-length signal if it is nonzero over a finite interval 

h < f (t) < h 

where t\ > — oo and ti < oo. An example can be seen in Figure 1.4. Similarly, an infinite-length signal, 
f(t), is defined as nonzero over all real numbers: 

oo < / (t) < — oo 
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Figure 1.4: Finite-Length Signal. Note that it only has nonzero values on a set, finite interval. 
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1.1.1.2.5 Causal vs. Anticausal vs. Noncausal 

Causal signals are signals that are zero for all negative time, while anticausal are signals that are zero for 
all positive time. Noncausal signals are signals that have nonzero values in both positive and negative time 
(Figure 1.5). 




zero here 
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Figure 1.5: (a) A causal signal (b) An anticausal signal (c) A noncausal signal 



1.1.1.2.6 Even vs. Odd 

An even signal is any signal / such that f (t) = /(—£). Even signals can be easily spotted as they 
are symmetric around the vertical axis. An odd signal, on the other hand, is a signal / such that 
f(t) = -f(-t) (Figure 1.6). 
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Figure 1.6: (a) An even signal (b) An odd signal 



Using the definitions of even and odd signals, we can show that any signal can be written as a combination 
of an even and odd signal. That is, every signal has an odd-even decomposition. To demonstrate this, we 
have to look no further than a single equation. 



f(t) = \{f{t) + /(-*)) + | (/ (*) - / (-*)) 



(1.2) 



By multiplying and adding this expression out, it can be shown to be true. Also, it can be shown that 
/ (t) + f (— t) fulfills the requirement of an even function, while / (t) — f (—t) fulfills the requirement of an 
odd function (Figure 1.7). 

Example 1.1 
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Figure 1.7: (a) The signal we will decompose using odd-even decomposition (b) Even part: e (£) 
| (/ (t) + / (-t)) (c) Odd part: o (£) = § (/ (t) - / (-i)) (d) Check: e{t) + o (t) = f (t) 



1.1.1.2.7 Deterministic vs. Random 

A deterministic signal is a signal in which each value of the signal is fixed and can be determined by a 
mathematical expression, rule, or table. Because of this the future values of the signal can be calculated 
from past values with complete confidence. On the other hand, a random signal 3 has a lot of uncertainty 
about its behavior. The future values of a random signal cannot be accurately predicted and can usually 
only be guessed based on the averages 4 of sets of signals (Figure 1.8). 



k M Jlfc 



(a) 



U" 



(b) 



Figure 1.8: (a) Deterministic Signal (b) Random Signal 



Example 1.2 

Consider the signal defined for all real t described by 



/(*) = { 



sin (2-rrt) /t t>\ 







t < 1 



(1.3) 



This signal is continuous time, analog, aperiodic, infinite length, causal, neither even nor odd, and, 
by definition, deterministic. 



1.1.1.3 Signal Classifications Summary 

This module describes just some of the many ways in which signals can be classified. They can be continuous 
time or discrete time, analog or digital, periodic or aperiodic, finite or infinite, and deterministic or random. 
We can also divide them based on their causality and symmetry properties. There are other ways to classify 
signals, such as boundedness, handedness, and continuity, that are not discussed here but will be described 
in subsequent modules. 



3 "Introduction to Random Signals and Processes" <http://cnx.org/content/ml0649/latest/> 
4 "Random Processes: Mean and Variance" <http://cnx.org/content/ml0656/latest/> 
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1.1.2 Signal Operations 5 

1.1.2.1 Introduction 

This module will look at two signal operations affecting the time parameter of the signal, time shifting and 
time scaling. These operations are very common components to real-world systems and, as such, should be 
understood thoroughly when learning about signals and systems. 

1.1.2.2 Manipulating the Time Parameter 

1.1.2.2.1 Time Shifting 

Time shifting is, as the name suggests, the shifting of a signal in time. This is done by adding or subtracting 
a quantity of the shift to the time variable in the function. Subtracting a fixed positive quantity from the 
time variable will shift the signal to the right (delay) by the subtracted quantity, while adding a fixed positive 
amount to the time variable will shift the signal to the left (advance) by the added quantity. 



fM 



f(t-T) 





Figure 1.9: / (t — T) moves (delays) / to the right by T. 



1.1.2.2.2 Time Scaling 

Time scaling compresses or dilates a signal by multiplying the time variable by some quantity. If that 
quantity is greater than one, the signal becomes narrower and the operation is called compression, while if 
the quantity is less than one, the signal becomes wider and is called dilation. 



5 This content is available online at <http://cnx.Org/content/ml0125/2.17/>. 
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Figure 1.10: / (at) compresses / by a. 



Example 1.3 

Given / (t) we woul like to plot / (at — b). The figure below describes a method to accomplish this. 
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Figure 1.11: (a) Begin with f (t) (b) Then replace t with at to get f (at) (c) Finally, replace t with 
t- £ to get /(o(t-£))=/ (at- 6) 
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1.1.2.2.3 Time Reversal 

A natural question to consider when learning about time scaling is: What happens when the time variable 
is multiplied by a negative number? The answer to this is time reversal. This operation is the reversal of 
the time axis, or flipping the signal over the y-axis. 




Figure 1.12: Reverse the time axis 
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1.1.2.3 Time Scaling and Shifting Demonstration 
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Figure 1.13: Download 6 or Interact (when online) with a Mathematica CDF demonstrating Discrete 
Harmonic Sinusoids. 



1.1.2.4 Signal Operations Summary 

Some common operations on signals affect the time parameter of the signal. One of these is time shifting in 
which a quantity is added to the time parameter in order to advance or delay the signal. Another is the time 
scaling in which the time parameter is multiplied by a quantity in order to dilate or compress the signal in 
time. In the event that the quantity involved in the latter operation is negative, time reversal occurs. 



1.1.3 Common Continuous Time Signals 

1.1.3.1 Introduction 

Before looking at this module, hopefully you have an idea of what a signal is and what basic classifications 
and properties a signal can have. In review, a signal is a function defined with respect to an independent 
variable. This variable is often time but could represent any number of things. Mathematically, continuous 



6 See the file at <http://cnx.org/content/ml0125/latest/TimeshifterDrill_display.cdf> 
7 This content is available online at <http://cnx.Org/content/ml0058/2.15/>. 
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time analog signals have continuous independent and dependent variables. This module will describe some 
useful continuous time analog signals. 

1.1.3.2 Important Continuous Time Signals 

1.1.3.2.1 Sinusoids 

One of the most important elemental signal that you will deal with is the real-valued sinusoid. In its 
continuous-time form, we write the general expression as 

Acos(ujt + 4>) (1.4) 

where A is the amplitude, u> is the frequency, and </> is the phase. Thus, the period of the sinusoid is 

T=— (1.5) 




Figure 1.14: Sinusoid with A — 2, w = 2, and <f> = 0. 



1.1.3.2.2 Complex Exponentials 

As important as the general sinusoid, the complex exponential function will become a critical part of your 
study of signals and systems. Its general continuous form is written as 

Ae st (1.6) 

where s = a + ju) is a complex number in terms of a, the attenuation constant, and to the angular frequency. 



1.1.3.2.3 Unit Impulses 

The unit impulse function, also known as the Dirac delta function, is a signal that has infinite height and 
infinitesimal width. However, because of the way it is defined, it integrates to one. While this signal is useful 
for the understanding of many concepts, a formal understanding of its definition more involved. The unit 
impulse is commonly denoted 5(t). 

More detail is provided in the section on the continuous time impulse function. For now, it suffices to 
say that this signal is crucially important in the study of continuous signals, as it allows the sifting property 
to be used in signal representation and signal decomposition. 



13 



1.1.3.2.4 Unit Step 

Another very basic signal is the unit-step function that is defined as 



«(*) 



if t < 

1 if t > 



(1.7) 
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Figure 1.15: Continuous-Time Unit-Step Function 



The step function is a useful tool for testing and for defining other signals. For example, when different 
shifted versions of the step function are multiplied by other signals, one can select a certain portion of the 
signal and zero out the rest. 

1.1.3.3 Common Continuous Time Signals Summary 

Some of the most important and most frequently encountered signals have been discussed in this module. 
There are, of course, many other signals of significant consequence not discussed here. As you will see later, 
many of the other more complicated signals will be studied in terms of those listed here. Especially take 
note of the complex exponentials and unit impulse functions, which will be the key focus of several topics 
included in this course. 

1.1,4 Continuous Time Impulse Function 8 

1.1.4.1 Introduction 

In engineering, we often deal with the idea of an action occurring at a point. Whether it be a force at 
a point in space or some other signal at a point in time, it becomes worth while to develop some way of 
quantitatively defining this. This leads us to the idea of a unit impulse, probably the second most important 
function, next to the complex exponential, in this systems and signals course. 



1.1.4.2 Dirac Delta Function 

The Dirac delta function, often referred to as the unit impulse or delta function, is the function that 
defines the idea of a unit impulse in continuous-time. Informally, this function is one that is infinitesimally 



3 This content is available online at <http://cnx.Org/content/ml0059/2.26/>. 
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narrow, infinitely tall, yet integrates to one. Perhaps the simplest way to visualize this is as a rectangular 
pulse from a — | to a + § with a height of -. As we take the limit of this setup as e approaches 0, we see 
that the width tends to zero and the height tends to infinity as the total area remains constant at one. The 
impulse function is often written as 5 (t). 



S (t) dt = 1 



(1.8) 
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Figure 1.16: This is one way to visualize the Dirac Delta Function. 
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Figure 1.17: Since it is quite difficult to draw something that is infinitely tall, we represent the Dirac 
with an arrow centered at the point it is applied. If we wish to scale it, we may write the value it is 
scaled by next to the point of the arrow. This is a unit impulse (no scaling). 



Below is a brief list a few important properties of the unit impulse without going into detail of their 
proofs. 

Unit Impulse Properties 
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. 5 (act) = fa6 (t) 

• 5{t) = S{-t) 

• S (t) = -^u (t), where u (t) is the unit step. 

• f(t)6(t) = f(0)6(t) 

The last of these is especially important as it gives rise to the sifting property of the dirac delta function, which 
selects the value of a function at a specific time and is especially important in studying the relationship of an 
operation called convolution to time domain analysis of linear time invariant systems. The sifting property 
is shown and derived below. 



f(t)S(t)dt 



f(0)S(t)dt=f(0) 5(t)dt=f(0) 



(1.9) 



1.1.4.3 Unit Impulse Limiting Demonstration 
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Figure 1.18: Click on the above thumbnail image (when online) to download an interactive Mathematica 
Player demonstrating the Continuous Time Impulse Function. 



1.1.4.4 Continuous Time Unit Impulse Summary 

The continuous time unit impulse function, also known as the Dirac delta function, is of great importance 
to the study of signals and systems. Informally, it is a function with infinite height ant infinitesimal width 
that integrates to one, which can be viewed as the limiting behavior of a unit area rectangle as it narrows 
while preserving area. It has several important properties that will appear again when studying systems. 
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1.1.5 Continuous Time Complex Exponential 9 

1.1.5.1 Introduction 

Complex exponentials are some of the most important functions in our study of signals and systems. Their 
importance stems from their status as eigenfunctions of linear time invariant systems. Before proceeding, 
you should be familiar with complex numbers. 

1.1.5.2 The Continuous Time Complex Exponential 

1.1.5.2.1 Complex Exponentials 

The complex exponential function will become a critical part of your study of signals and systems. Its general 
continuous form is written as 

Ae st (1.10) 

where s = a + ico is a complex number in terms of a, the attenuation constant, and u> the angular frequency. 

1.1.5.2.2 Euler's Formula 

The mathematician Euler proved an important identity relating complex exponentials to trigonometric func- 
tions. Specifically, he discovered the eponymously named identity, Euler's formula, which states that 

e JX = cos (x) + jsin (x) (1-H) 

which can be proven as follows. 

In order to prove Euler's formula, we start by evaluating the Taylor series for e z about z = 0, which 
converges for all complex z, at z = jx. The result is 

e jx _ y^oo {jx) k 

= Er =0 (-i) fc (ft+jEr = o(-i) fe (f^ (i-i 2 ) 

= cos (x) + jsin (x) 

because the second expression contains the Taylor series for cos (x) and sin (x) about t = 0, which converge 
for all real x. Thus, the desired result is proven. 
Choosing x = cut this gives the result 

e jut = cos {tot) + jsin (cot) (1.13) 

which breaks a continuous time complex exponential into its real part and imaginary part. Using this 
formula, we can also derive the following relationships. 

cos (cut) = -e jut + -e~^* (1.14) 

sin (cut) = — e jwt - —e- jut (1.15) 

2.7 2j 



9 This content is available online at <http://cnx.Org/content/ml0060/2.24/>. 
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1.1.5.2.3 Continuous Time Phasors 

It has been shown how the complex exponential with purely imaginary frequency can be broken up into 
its real part and its imaginary part. Now consider a general complex frequency s = a + luj where a is the 
attenuation factor and u> is the frequency. Also consider a phase difference 8. It follows that 



e (*+ju)t+jO = e at ( cos ^ t + e - }+ jgin ^ t + g ^ 
Thus, the real and imaginary parts of e st appear below. 



Be{e^ +ju,)t+jB } = e at cos (ut + 9) 



(1.16) 



(1.17) 



Im{ 



,(<r+ju)t+j6 



} = e at sin (tut + 6) 



(1.18) 



Using the real or imaginary parts of complex exponential to represent sinusoids with a phase delay multiplied 
by real exponential is often useful and is called attenuated phasor notation. 

We can see that both the real part and the imaginary part have a sinusoid times a real exponential. We 
also know that sinusoids oscillate between one and negative one. Prom this it becomes apparent that the 
real and imaginary parts of the complex exponential will each oscillate within an envelope defined by the 
real exponential part. 





(a) 



(b) 




(c) 

Figure 1.19: The shapes possible for the real part of a complex exponential. Notice that the oscillations 
are the result of a cosine, as there is a local maximum at t — 0. (a) If a is negative, we have the case of 
a decaying exponential window, (b) If a is positive, we have the case of a growing exponential window, 
(c) If a is zero, we have the case of a constant window. 
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1.1.5.3 Complex Exponential Demonstration 



Continuous-time complex sinusoids and complex exponentials 

A continuous lime complex sinusoid of the form r ux . Vary £1 with the slider. What is the period of the function when fl = 1? 27 x? 2x? 
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A continuous time complex exponential of the form r . vary s by using the crosshair locator on the left part of the plot. The right side shows the 
resulting function. What happens when you vary the Re|s] (horizontal) component? The lm|s| (vertical) component? 
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Figure 1.20: Interact (when online) with a Mathematica CDF demonstrating the Continuous Time 
Complex Exponential. To Download, right-click and save target as .cdf. 



1.1.5.4 Continuous Time Complex Exponential Summary 

Continuous time complex exponentials are signals of great importance to the study of signals and systems. 
They can be related to sinusoids through Euler's formula, which identifies the real and imaginary parts of 
purely imaginary complex exponentials. Eulers formula reveals that, in general, the real and imaginary parts 
of complex exponentials are sinusoids multiplied by real exponentials. Thus, attenuated phasor notation is 
often useful in studying these signals. 
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1.1.6 Discrete-Time Signals 10 

So far, we have treated what are known as analog signals and systems. Mathematically, analog signals are 
functions having continuous quantities as their independent variables, such as space and time. Discrete-time 
signals 11 are functions defined on the integers; they are sequences. One of the fundamental results of signal 
theory 12 will detail conditions under which an analog signal can be converted into a discrete-time one and 
retrieved without error. This result is important because discrete-time signals can be manipulated by 
systems instantiated as computer programs. Subsequent modules describe how virtually all analog signal 
processing can be performed with software. 

As important as such results are, discrete-time signals are more general, encompassing signals derived 
from analog ones and signals that aren't. For example, the characters forming a text file form a sequence, 
which is also a discrete-time signal. We must deal with such symbolic valued 13 signals and systems as well. 

As with analog signals, we seek ways of decomposing real- valued discrete-time signals into simpler com- 
ponents. With this approach leading to a better understanding of signal structure, we can exploit that 
structure to represent information (create ways of representing information with signals) and to extract in- 
formation (retrieve the information thus represented). For symbolic- valued signals, the approach is different: 
We develop a common representation of all symbolic- valued signals so that we can embody the information 
they contain in a unified way. From an information representation perspective, the most important issue 
becomes, for both real-valued and symbolic-valued signals, efficiency; What is the most parsimonious and 
compact way to represent information so that it can be extracted later. 

1.1.6.1 Real- and Complex-valued Signals 

A discrete-time signal is represented symbolically as s (n), where n = {. . . , — 1, 0, 1, . . . }. We usually draw 
discrete-time signals as stem plots to emphasize the fact they are functions defined only on the integers. 
We can delay a discrete-time signal by an integer just as with analog ones. A delayed unit sample has the 
expression 5 (n — m), and equals one when n = m. 

Discrete-Time Cosine Signal 

Asn 



1q> 
O 







TU 



o 

Figure 1.21: The discrete-time cosine signal is plotted as a stem plot. Can you find the formula for 
this signal? 



10 This content is available online at <http://cnx.Org/content/m0009/2.24/>. 

11 "Discrete-Time Signals and Systems" <http://cnx.org/content/ml0342/latest/> 

12 "The Sampling Theorem" <http://cnx.org/content/m0050/latest/> 

13 "Discrete-Time Signals and Systems" <http://cnx.Org/content/ml0342/latest/#parall> 
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1.1.6.2 Complex Exponentials 

The most important signal is, of course, the complex exponential sequence. 

s(n) = e l2llfn (1.19) 

1.1.6.3 Sinusoids 

Discrete-time sinusoids have the obvious form s (n) = Acos(2irfn + <fi). As opposed to analog complex 
exponentials and sinusoids that can have their frequencies be any real value, frequencies of their discrete- 
time counterparts yield unique waveforms only when / lies in the interval (—5, §]- This property can be 
easily understood by noting that adding an integer to the frequency of the discrete-time complex exponential 
has no effect on the signal's value. 

p i2iT(f-\-m)n _ p i2irfn p i2-Kmn 

(1.20) 

— e J 

This derivation follows because the complex exponential evaluated at an integer multiple of 2tt equals one. 

1.1.6.4 Unit Sample 

The second-most important discrete-time signal is the unit sample, which is defined to be 

. 1 if n = 
S(n)={ (1.21) 

otherwise 



Unit Sample 
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Figure 1.22: The unit sample. 



Examination of a discrete-time signal's plot, like that of the cosine signal shown in Figure 1.21 (Discrete- 
Time Cosine Signal), reveals that all signals consist of a sequence of delayed and scaled unit samples. Because 
the value of a sequence at each integer m is denoted by s (m) and the unit sample delayed to occur at m is 
written S (n — m), we can decompose any signal as a sum of unit samples delayed to the appropriate location 

and scaled by the signal value. 

00 

s(n)= ^2 s(m)5(n-m) (1.22) 

m— — OO 

This kind of decomposition is unique to discrete-time signals, and will prove useful subsequently. 



21 

Discrete-time systems can act on discrete-time signals in ways similar to those found in analog signals 
and systems. Because of the role of software in discrete-time systems, many more different systems can 
be envisioned and "constructed" with programs than can be with analog signals. In fact, a special class of 
analog signals can be converted into discrete-time signals, processed with software, and converted back into 
an analog signal, all without the incursion of error. For such signals, systems can be easily produced in 
software, with equivalent analog realizations difficult, if not impossible, to design. 

1.1.6.5 Symbolic-valued Signals 

Another interesting aspect of discrete-time signals is that their values do not need to be real numbers. We 
do have real-valued discrete-time signals like the sinusoid, but we also have signals that denote the sequence 
of characters typed on the keyboard. Such characters certainly aren't real numbers, and as a collection of 
possible signal values, they have little mathematical structure other than that they are members of a set. 
More formally, each element of the symbolic-valued signal s (n) takes on one of the values {ai, . . . , <jk} which 
comprise the alphabet A. This technical terminology does not mean we restrict symbols to being mem- 
bers of the English or Greek alphabet. They could represent keyboard characters, bytes (8-bit quantities), 
integers that convey daily temperature. Whether controlled by software or not, discrete-time systems are 
ultimately constructed from digital circuits, which consist entirely of analog circuit elements. Furthermore, 
the transmission and reception of discrete-time signals, like e-mail, is accomplished with analog signals and 
systems. Understanding how discrete-time and analog signals and systems intertwine is perhaps the main 
goal of this course. 
[Media Object] 14 

1.2 Systems 

1.2.1 System Classifications and Properties 15 

1.2.1.1 Introduction 

In this module some of the basic classifications of systems will be briefly introduced and the most important 
properties of these systems are explained. As can be seen, the properties of a system provide an easy way 
to distinguish one system from another. Understanding these basic differences between systems, and their 
properties, will be a fundamental concept used in all signal and system courses. Once a set of systems can be 
identified as sharing particular properties, one no longer has to reprove a certain characteristic of a system 
each time, but it can simply be known due to the the system classification. 

1.2.1.2 Classification of Systems 

1.2.1.2.1 Continuous vs. Discrete 

One of the most important distinctions to understand is the difference between discrete time and continuous 
time systems. A system in which the input signal and output signal both have continuous domains is said 
to be a continuous system. One in which the input signal and output signal both have discrete domains is 
said to be a discrete system. Of course, it is possible to conceive of signals that belong to neither category, 
such as systems in which sampling of a continuous time signal or reconstruction from a discrete time signal 
take place. 



14 This media object is a Lab VIEW VI. Please view or download it at 
<SignalApprox.llb> 
15 This content is available online at <http://cnx.Org/content/ml0084/2.22/>. 
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1.2.1.2.2 Linear vs. Nonlinear 

A linear system is any system that obeys the properties of scaling (first order homogeneity) and superposition 
(additivity) further described below. A nonlinear system is any system that does not have at least one of 
these properties. 

To show that a system H obeys the scaling property is to show that 



H (kf (i)) = kH (/ (*)) 



(1.23) 



f(t)-»®->[H]->y(t) =f(t)->E 



A. 



K 



® -> y(t) 



K 



Figure 1.23: A block diagram demonstrating the scaling property of linearity 



To demonstrate that a system H obeys the superposition property of linearity is to show that 

H (A (t) + h (*)) = H (A (t)) + H (f 2 (tj) (1.24) 



© 



H 








H 



© 



Figure 1.24: A block diagram demonstrating the superposition property of linearity 



It is possible to check a system for linearity in a single (though larger) step. To do this, simply combine 
the first two steps to get 



H (fciA (t) + k 2 f 2 (t)) = k 2 H (h (t)) + k 2 H (f 2 (*)) 



(1.25) 



23 



1.2.1.2.3 Time Invariant vs. Time Varying 

A system is said to be time invariant if it commutes with the parameter shift operator defined by St (/ (£)) 
f(t-T) for all T, which is to say 



HSt = StH 



(1.26) 



for all real T. Intuitively, that means that for any input function that produces some output function, any 
time shift of that input function will produce an output function identical in every way except that it is 
shifted by the same amount. Any system that does not have this property is said to be time varying. 



f(l) 



^V 



T 



H 



y (t-T) 



f(t-T> 








v it T) 



Figure 1.25: This block diagram shows what the condition for time invariance. The output is the 
same whether the delay is put on the input or the output. 



1.2.1.2.4 Causal vs. Noncausal 

A causal system is one in which the output depends only on current or past inputs, but not future inputs. 
Similarly, an anticausal system is one in which the output depends only on current or future inputs, but not 
past inputs. Finally, a noncausal system is one in which the output depends on both past and future inputs. 
All "realtime" systems must be causal, since they can not have future inputs available to them. 

One may think the idea of future inputs does not seem to make much physical sense; however, we have 
only been dealing with time as our dependent variable so far, which is not always the case. Imagine rather 
that we wanted to do image processing. Then the dependent variable might represent pixel positions to the 
left and right (the "future") of the current position on the image, and we would not necessarily have a causal 
system. 
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f(t) > 



-> y(t) 



(a) 




y(t|j) is a function of only 
these values 



(b) 

Figure 1.26: (a) For a typical system to be causal... (b) ...the output at time to, y(to), can only 
depend on the portion of the input signal before to. 



1.2.1.2.5 Stable vs. Unstable 

There are several definitions of stability, but the one that will be used most frequently in this course will 
be bounded input, bounded output (BIBO) stability. In this context, a stable system is one in which the 
output is bounded if the input is also bounded. Similarly, an unstable system is one in which at least one 
bounded input produces an unbounded output. 

Representing this mathematically, a stable system must have the following property, where x (t) is the 
input and y (t) is the output. The output must satisfy the condition 



\y(t)\ < M y <oo 
whenever we have an input to the system that satisfies 

\x (t) | < M x < oo 



(1.27) 



(1.28) 



M x and M y both represent a set of finite positive numbers and these relationships hold for all of t. Otherwise, 
the system is unstable. 



1.2.1.3 System Classifications Summary 

This module describes just some of the many ways in which systems can be classified. Systems can be 
continuous time, discrete time, or neither. They can be linear or nonlinear, time invariant or time varying, 
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and stable or unstable. We can also divide them based on their causality properties. There are other ways 
to classify systems, such as use of memory, that are not discussed here but will be described in subsequent 
modules. 

1.2.2 Linear Time Invariant Systems 16 

1.2.2.1 Introduction 

Linearity and time invariance are two system properties that greatly simplify the study of systems that exhibit 
them. In our study of signals and systems, we will be especially interested in systems that demonstrate both 
of these properties, which together allow the use of some of the most powerful tools of signal processing. 

1.2.2.2 Linear Time Invariant Systems 

1.2.2.2.1 Linear Systems 

If a system is linear, this means that when an input to a given system is scaled by a value, the output of the 
system is scaled by the same amount. 

Linear Scaling 



x * 



-*■ y 



ax ^ 



-*■ ay 



(a) 



(b) 



Figure 1.27 



In Figure 1.27(a) above, an input x to the linear system L gives the output y. If x is scaled by a value 
a and passed through this same system, as in Figure 1.27(b), the output will also be scaled by a. 

A linear system also obeys the principle of superposition. This means that if two inputs are added 
together and passed through a linear system, the output will be the sum of the individual inputs' outputs. 



xi *■ 



-*■ yi 



X2 *■ 



-*■ yz 



(a) 



(b) 



Figure 1.28 



16 This content is available online at <http://cnx.Org/content/m2102/2.24/>. 
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Superposition Principle 



3!i + yi *■ 



■*■ Xi +y% 



Figure 1.29: If Figure 1.28 is true, then the principle of superposition says that Figure 1.29 (Superpo- 
sition Principle) is true as well. This holds for linear systems. 



That is, if Figure 1.28 is true, then Figure 1.29 (Superposition Principle) is also true for a linear system. 
The scaling property mentioned above still holds in conjunction with the superposition principle. Therefore, 
if the inputs x and y are scaled by factors a and /3, respectively, then the sum of these scaled inputs will 
give the sum of the individual scaled outputs: 



Ml >■ 



-*- <*yt 



0x* *■ 



■*■ PV* 



(a) 



(b) 



Figure 1.30 



Superposition Principle with Linear Scaling 



ail + ^3!a * 



-*- ayi + fiy% 



Figure 1.31: Given Figure 1.30 for a linear system, Figure 1.31 (Superposition Principle with Linear 
Scaling) holds as well. 
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Example 1.4 

Consider the system Hi in which 

H 1 (f(t)) = tf(t) (1.29) 

for all signals /. Given any two signals /, g and scalars a, b 

Hi (af (t) + bg (*)) = t (af (t) + bg (*)) = at/ (t) + big (t) = offi (/ (t)) + MTi (<? (*)) (1-30) 

for all real t. Thus, Hi is a linear system. 

Example 1.5 

Consider the system Hi in which 

H 2 (f(t)) = (f(t)) 2 (1.31) 

for all signals /. Because 

iJ 2 (2t) = At 2 =£ 2t 2 = 2H 2 (t) (1.32) 

for nonzero t, H 2 is not a linear system. 



1.2.2.2.2 Time Invariant Systems 

A time-invariant system has the property that a certain input will always give the same output (up to 
timing), without regard to when the input was applied to the system. 



Time-Invariant Systems 



r(t) 



TI 



■*¥(*) 



b(* - *o) 



TI 



■+- y(t - ta) 



(a) 



(b) 



Figure 1.32: Figure 1.32(a) shows an input at time t while Figure 1.32(b) shows the same input 
io seconds later. In a time-invariant system both outputs would be identical except that the one in 
Figure 1.32(b) would be delayed by to. 



In this figure, x (t) and x (t — t ) are passed through the system TI. Because the system TI is time- 
invariant, the inputs x (t) and x (t — to) produce the same output. The only difference is that the output 
due to x (t — to) is shifted by a time to- 

Whether a system is time-invariant or time- varying can be seen in the differential equation (or difference 
equation) describing it. Time-invariant systems are modeled with constant coefficient equations. 
A constant coefficient differential (or difference) equation means that the parameters of the system are not 
changing over time and an input now will give the same result as the same input later. 
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Example 1.6 

Consider the system Hi in which 



for all signals /. Because 



H 1 (f(t)) = tf(t) 



S T (#i (/ (t))) = S T (tf (*)) = (t -T) f (t - T) ^ tf (t -T) = H x (f (t - T)) = H x (S T (f (t))) 
for nonzero T, Hi is not a time invariant system. 

Example 1.7 

Consider the system Hi in which 

H 2 (f(t)) = (f(t)f 
for all signals /. For all real T and signals /, 

St (H 2 (f (t))) = S T (f(tf) = (f (t - T)f = H 2 (f (t - T)) = H 2 (S T (f (*))) 
for all real t. Thus, H 2 is a time invariant system. 



(1.33) 
(1.34) 



(1.35) 
(1.36) 



1.2.2.2.3 Linear Time Invariant Systems 

Certain systems are both linear and time-invariant, and are thus referred to as LTI systems. 

Linear Time-Invariant Systems 



r.(t) 



LTI 



*(*) 



n(*-* n ) 



LTI 



<*y(t -*n) 



(a) 



(b) 



Figure 1.33: This is a combination of the two cases above. Since the input to Figure 1.33(b) is a scaled, 
time-shifted version of the input in Figure 1.33(a), so is the output. 



As LTI systems are a subset of linear systems, they obey the principle of superposition. In the figure 
below, we see the effect of applying time-invariance to the superposition definition in the linear systems 
section above. 
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3!l(*) *• 



LTI 



■*■ Vl(t) r,i(t) *■ 



LTI 



■*»(*) 



(a) 



(b) 



Figure 1.34 



Superposition in Linear Time-Invariant Systems 



Ml(*-*l) +^3! 2 (*-*a) *- 



LTI 



■+ ayL(t-h)+Pva(t-ta) 



Figure 1.35: The principle of superposition applied to LTI systems 



1.2.2.2.3.1 LTI Systems in Series 

If two or more LTI systems are in series with each other, their order can be interchanged without affecting 
the overall output of the system. Systems in series are also called cascaded systems. 
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Cascaded LTI Systems 



#1 



Hi 



(a) 



Hi 



H 



(b) 

Figure 1.36: The order of cascaded LTI systems can be interchanged without changing the overall 
effect. 



1.2.2.2.3.2 LTI Systems in Parallel 

If two or more LTI systems are in parallel with one another, an equivalent system is one that is defined as 
the sum of these individual systems. 



Parallel LTI Systems 







H L 


| 










* 


H 2 



H^+Hi 



(a) (b) 

Figure 1.37: Parallel systems can be condensed into the sum of systems. 
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Example 1.8 

Consider the system H 3 in which 

H 3 (/(*)) = 2/ (i) (1.37) 

for all signals /. Given any two signals /, g and scalars a, b 

H 3 (0/ (t) + 63 (t)) = 2 (a/ (t) + 6 5 (*)) = o2/ (i) + &2 5 (i) = aff 3 (/ (*)) + &#3 (5 (*)) (1-38) 

for all real t. Thus, H 3 is a linear system. For all real T and signals /, 

S T (H 3 (f (*))) = S T (2/ (*)) = 2/ (i - T) = ff 3 (/ (t - T)) = H 3 (S T (/ (t))) (1.39) 

for all real t. Thus, i?3 is a time invariant system. Therefore, H 3 is a linear time invariant system. 

Example 1.9 

As has been previously shown, each of the following systems are not linear or not time invariant. 

H 1 (f(t)) = tf(t) (1.40) 

H 2 (f(t)) = (f(t)f (1.41) 

Thus, they are not linear time invariant systems. 

1.2.2.3 Linear Time Invariant Demonstration 



Image not finished 



Figure 1.38: Interact (when online) with the Mathematica CDF above demonstrating Linear Time 
Invariant systems. To download, right click and save file as .cdf. 



1.2.2.4 LTI Systems Summary 

Two very important and useful properties of systems have just been described in detail. The first of these, 
linearity, allows us the knowledge that a sum of input signals produces an output signal that is the summed 
original output signals and that a scaled input signal produces an output signal scaled from the original 
output signal. The second of these, time invariance, ensures that time shifts commute with application of 
the system. In other words, the output signal for a time shifted input is the same as the output signal for the 
original input signal, except for an identical shift in time. Systems that demonstrate both linearity and time 
invariance, which are given the acronym LTI systems, are particularly simple to study as these properties 
allow us to leverage some of the most powerful tools in signal processing. 
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1.3 Time Domain Analysis of Continuous Time Systems 
1.3.1 Continuous Time Convolution 17 

1.3.1.1 Introduction 

Convolution, one of the most important concepts in electrical engineering, can be used to determine the 
output a system produces for a given input signal. It can be shown that a linear time invariant system 
is completely characterized by its impulse response. The sifting property of the continuous time impulse 
function tells us that the input signal to a system can be represented as an integral of scaled and shifted 
impulses and, therefore, as the limit of a sum of scaled and shifted approximate unit impulses. Thus, by 
linearity, it would seem reasonable to compute of the output signal as the limit of a sum of scaled and 
shifted unit impulse responses and, therefore, as the integral of a scaled and shifted impulse response. That 
is exactly what the operation of convolution accomplishes. Hence, convolution can be used to determine a 
linear time invariant system's output from knowledge of the input and the impulse response. 

1.3.1.2 Convolution and Circular Convolution 
1.3.1.2.1 Convolution 

1.3.1.2.1.1 Operation Definition 

Continuous time convolution is an operation on two continuous time signals defined by the integral 



(f*9)(t)= f(T)g(t-T)dT (1.42) 

J — oo 

for all signals /, g defined on IL It is important to note that the operation of convolution is commutative, 
meaning that 

f*9 = 9*f (1-43) 

for all signals /, g defined on IL Thus, the convolution operation could have been just as easily stated using 
the equivalent definition 



(f*9)(t)= f(t-T)g( T )dT (1.44) 

J — oo 

for all signals /, g defined on IL Convolution has several other important properties not listed here but 
explained and derived in a later module. 

1.3.1.2.1.2 Definition Motivation 

The above operation definition has been chosen to be particularly useful in the study of linear time invariant 
systems. In order to see this, consider a linear time invariant system H with unit impulse response h. Given 
a system input signal x we would like to compute the system output signal H (x). First, we note that the 
input can be expressed as the convolution 



x{t)= / x{r)S{t-T)dT (1.45) 

J — oo 

by the sifting property of the unit impulse function. Writing this integral as the limit of a summation, 

x (t) = lim^x (nA) S A {t - nA) A (1.46) 



7 This content is available online at <http://cnx.Org/content/ml0085/2.34/>. 
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where 

1/A < t < A 

m*) = { ; (i-47) 

otherwise 
approximates the properties of S(t). By linearity 

Ex (t) = lim^x (nA) ff(5 A (t - nA) A (1.48) 

n 

which evaluated as an integral gives 

/oo 
x (t) HS (t - t) dr. (1.49) 

-oo 

Since HS (t — r) is the shifted unit impulse response h(t — r), this gives the result 

Hx(t)= x(T)h{t-T)dT= (x*h)(t) . (1.50) 



Hence, convolution has been defined such that the output of a linear time invariant system is given by the 
convolution of the system input with the system unit impulse response. 

1.3.1.2.1.3 Graphical Intuition 

It is often helpful to be able to visualize the computation of a convolution in terms of graphical processes. 
Consider the convolution of two functions /, g given by 



(f*9)(t)= f(T)g(t-T)dT= f(t-T)g(T)dT. (1.51) 

J— oo J —oo 

The first step in graphically understanding the operation of convolution is to plot each of the functions. 
Next, one of the functions must be selected, and its plot reflected across the t = axis. For each real t, that 
same function must be shifted left by t. The product of the two resulting plots is then constructed. Finally, 
the area under the resulting curve is computed. 

Example 1.10 

Recall that the impulse response for the capacitor voltage in a series RC circuit is given by 

Ht) = ^ d e- t ' RC u{t), (1.52) 

and consider the response to the input voltage 

x{t) = u{t). (1.53) 

We know that the output for this input voltage is given by the convolution of the impulse response 
with the input signal 

y(t)=x(t)*h{i). (1.54) 

We would like to compute this operation by beginning in a way that minimizes the algebraic 
complexity of the expression. Thus, since x (t) = u (t) is the simpler of the two signals, it is 
desirable to select it for time reversal and shifting. Thus, we would like to compute 

/OO I 

— e-^ RC u(T)u(t-r)dT. (1.55) 
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The step functions can be used to further simplify this integral by narrowing the region of inte- 
gration to the nonzero region of the integrand. Therefore, 



Hence, the output is 



which can also be written as 



t>max{0,t} -i 

y(t) = j o Rc e ~ T/RCdT - (L56) 



y(t) = { tmr ~ (i-57) 

1 _ e -t/RC t > q 



y{t)=(l-e~ t l RC )u{t). (1.58) 



1.3.1.2.2 Circular Convolution 

Continuous time circular convolution is an operation on two finite length or periodic continuous time signals 
defined by the integral 

(f*9)(t)= I f(r)9(t-T)dT (1.59) 

Jo 

for all signals /, g defined on M. [0, T] where /, <? are periodic extensions of / and g. It is important to note 
that the operation of circular convolution is commutative, meaning that 

f*g = g*f (1-60) 

for all signals /, g defined on M. [0, T]. Thus, the circular convolution operation could have been just as easily 
stated using the equivalent definition 

(f*g)(t)= I f(t-T)g( T )dT (i.6i) 

Jo 

for all signals /, g defined on K[0,T] where f,g are periodic extensions of / and g. Circular convolution 
has several other important properties not listed here but explained and derived in a later module. 

Alternatively, continuous time circular convolution can be expressed as the sum of two integrals given by 

(f*g)(t)= f f(r)g(t-T)dT+ f f( T )g(t-T + T)dT (1.62) 

Jo Jt 

for all signals /, g defined on M. [0, T\. 

Meaningful examples of computing continuous time circular convolutions in the time domain would in- 
volve complicated algebraic manipulations dealing with the wrap around behavior, which would ultimately 
be more confusing than helpful. Thus, none will be provided in this section. However, continuous time circu- 
lar convolutions are more easily computed using frequency domain tools as will be shown in the continuous 
time Fourier series section. 
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1.3.1.2.2.1 Definition Motivation 

The above operation definition has been chosen to be particularly useful in the study of linear time invariant 
systems. In order to see this, consider a linear time invariant system H with unit impulse response h. Given 
a finite or periodic system input signal x we would like to compute the system output signal H (x). First, 
we note that the input can be expressed as the circular convolution 

x(t) = x (r) 5 {t-T)dr (1.63) 

Jo 

by the sifting property of the unit impulse function. Writing this integral as the limit of a summation, 

x{t) = lim^x (nA) SA{t-nA)A (1.64) 

n 

where 

1/A < t < A 
S A (t) = { ' ~ (1.65) 

otherwise 

approximates the properties of 8(t). By linearity 

Hx (t) = Urn Y^ x (nA) H $ A (t - nA) A (1.66) 

n 

which evaluated as an integral gives 



Hx(t)= x ( T )H S {t-T)dT. (1.67) 

Jo 

Since HS (t — r) is the shifted unit impulse response h(t — r), this gives the result 

Hx{t)= x (r) h{t-T)dr= (x*h)(t). (1.68) 

Jo 

Hence, circular convolution has been defined such that the output of a linear time invariant system is given 
by the convolution of the system input with the system unit impulse response. 

1.3.1.2.2.2 Graphical Intuition 

It is often helpful to be able to visualize the computation of a circular convolution in terms of graphical 
processes. Consider the circular convolution of two finite length functions /, g given by 

(/ *g)(t)= I f (r) 9(t-T)dr= f f(t-r)g (t) dr. (1.69) 

Jo Jo 

The first step in graphically understanding the operation of convolution is to plot each of the periodic 
extensions of the functions. Next, one of the functions must be selected, and its plot reflected across the 
t = axis. For each t € R[0,T], that same function must be shifted left by t. The product of the two 
resulting plots is then constructed. Finally, the area under the resulting curve on R [0,T] is computed. 
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1.3.1.3 Convolution Demonstration 
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Figure 1.39: Interact (when online) with a Mathematica CDF demonstrating Convolution. To Down- 
load, right-click and save target as xdf. 



1.3.1.4 Convolution Summary 

Convolution, one of the most important concepts in electrical engineering, can be used to determine the 
output signal of a linear time invariant system for a given input signal with knowledge of the system's unit 
impulse response. The operation of continuous time convolution is defined such that it performs this function 
for infinite length continuous time signals and systems. The operation of continuous time circular convolution 
is defined such that it performs this function for finite length and periodic continuous time signals. In each 
case, the output of the system is the convolution or circular convolution of the input signal with the unit 
impulse response. 



1.3.2 Properties of Continuous Time Convolution 18 

1.3.2.1 Introduction 

We have already shown the important role that continuous time convolution plays in signal processing. This 
section provides discussion and proof of some of the important properties of continuous time convolution. 
Analogous properties can be shown for continuous time circular convolution with trivial modification of the 
proofs provided except where explicitly noted otherwise. 



3 This content is available online at <http://cnx.Org/content/ml0088/2.17/>. 
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1.3.2.2 Continuous Time Convolution Properties 

1.3.2.2.1 Associativity 

The operation of convolution is associative. That is, for all continuous time signals /i,/2,/3 the following 
relationship holds. 

A * (A * A) = (A * A) * A (1-70) 

In order to show this, note that 

(A * (A * A)) (t) = JZo JZo h (n) A (r 2 ) A ((< - n) - r 2 ) efodn 



oo J —oo • 

Ho JZo A (n) A ((n + r 2 ) - n ) A (t - (n + r 2 )) d-^dn 

CO |-CO 
CO J— CO • 



(1.71) 



A°L A°L A (ti) A (r 3 - ri) A (* - 7 3 ) dridr 3 

= ((A * A) * A) (t) 

proving the relationship as desired through the substitution T3 = n + r 2 . 

1.3.2.2.2 Commutativity 

The operation of convolution is commutative. That is, for all continuous time signals f\, / 2 the following 
relationship holds. 

A * A = A * A (1-72) 

In order to show this, note that 

(A*A)W =A 00 co A(ri)A(*-T 1 )dT 1 

= A° 00 A(i-T 2 )A(T2)dT 2 (i-73) 

= (A * A) (t) 

proving the relationship as desired through the substitution r 2 = t — T\. 

1.3.2.2.3 Distribitivity 

The operation of convolution is distributive over the operation of addition. That is, for all continuous time 
signals A) A) A the following relationship holds. 

A * (A + A) = A * A + A * A U-74) 

In order to show this, note that 

(A * (A + A)) (t) = JZo A (A (A (t-r) + A (t - A) dr 

= JZo h (r) A (* - r) dr + /^ A (r) A (< - r) dr (1.75) 

= (A * A + A * A) (t) 

proving the relationship as desired. 
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1.3.2.2.4 Multilinearity 

The operation of convolution is linear in each of the two function variables. Additivity in each variable 
results from distributivity of convolution over addition. Homogenity of order one in each varible results from 
the fact that for all continuous time signals f\, / 2 and scalars o the following relationship holds. 

a (fi * h) = (o/i) * / 2 = /i * (o/ 2 ) (1-76) 

In order to show this, note that 

(a (/1 * h)) (t) =a J^ h (r) f 2 (t - r) dr 
= l 00 co («/i(r))/ 2 (^-r)dr 

= ((0/1) * h) (t) (1-77) 

= jr cc fi(r)(ah(t-r))dT 
= (/1 * (a/2)) (t) 
proving the relationship as desired. 

1.3.2.2.5 Conjugation 

The operation of convolution has the following property for all continuous time signals fi,fz- 

(1.78) 



order to show this, 


note that 




h 


* h = 


/1 * h 






(h 


* h) (t) 


~ J—oc 

j-OO 

J— oc 


,/iWM*- 

, /1 W h (t ~ 


- t) dr 

- r)dr 



(1.79) 
= r oo h(r)T2(t-r)dr 

proving the relationship as desired. 

1.3.2.2.6 Time Shift 

The operation of convolution has the following property for all continuous time signals /i,/2 where St is 
the time shift operator. 

St (fi * h) = (Srfi) *h = h* (St/2) (1-80) 

In order to show this, note that 



St (/1 * / 2 ) (t) = /^ / 2 (r) h ((< - T) - r) dr 
= l°° co /2(r)5 T / 1 (t-r)dr 

= ((St/i) * / 2 ) (t) 



(1.81) 
/!L/i(r)/ 2 ((t-T)-r)dr ' ' 

= /-°°oc A to St/2 (t-r)dr 
= /1 * (Sr/ 2 ) (t) 



proving the relationship as desired. 
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1.3.2.2.7 Differentiation 

The operation of convolution has the following property for all continuous time signals / 1; / 2 . 



d 
dt 

In order to show this, note that 



C*. A) (t) =(£.*) (*) = (*.£)(*) 



(1.82) 



(/i*/ 2 )(*) =C 00 f2(r)if 1 (t-r)dr 
i*/ 2 )(*) 



(1.83) 

C/iMlMt-r)dr 



(/i * f ) (*) 



proving the relationship as desired. 



1.3.2.2.8 Impulse Convolution 



The operation of convolution has the following property for all continuous time signals / where 6 is the Dirac 
delta funciton. 



f*8 = f (1.84) 



In order to show this, note that 



(/**)(*) =C 00 f(r)5(t-r)dr 

= f(t)C 00 5(t-r)dr (1.85) 

= /(*) 

proving the relationship as desired. 

1.3.2.2.9 Width 

The operation of convolution has the following property for all continuous time signals /i,/2 where 
Duration (/) gives the duration of a signal /. 

Duration (/i * / 2 ) = Duration (/i) + Duration (/ 2 ) (1.86) 

. In order to show this informally, note that (/i * / 2 ) (t) is nonzero for all t for which there is a r such that 
A ( T ) /2 (i — r ) is nonzero. When viewing one function as reversed and sliding past the other, it is easy to 
see that such a r exists for all t on an interval of length Duration (f\) + Duration (/ 2 ). Note that this is not 
always true of circular convolution of finite length and periodic signals as there is then a maximum possible 
duration within a period. 

1.3.2.3 Convolution Properties Summary 

As can be seen the operation of continuous time convolution has several important properties that have 
been listed and proven in this module. With slight modifications to proofs, most of these also extend to 
continuous time circular convolution as well and the cases in which exceptions occur have been noted above. 
These identities will be useful to keep in mind as the reader continues to study signals and systems. 
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1.4 Frequency Domain 

1.4.1 Introduction to the Frequency Domain 19 

In developing ways of analyzing linear circuits, we invented the impedance method because it made solving 
circuits easier. Along the way, we developed the notion of a circuit's frequency response or transfer function. 
This notion, which also applies to all linear, time-invariant systems, describes how the circuit responds to a 
sinusoidal input when we express it in terms of a complex exponential. We also learned the Superposition 
Principle for linear systems: The system's output to an input consisting of a sum of two signals is the sum 
of the system's outputs to each individual component. 

The study of the frequency domain combines these two notions-a system's sinusoidal response is easy to 
find and a linear system's output to a sum of inputs is the sum of the individual outputs-to develop the 
crucial idea of a signal's spectrum. We begin by finding that those signals that can be represented as a 
sum of sinusoids is very large. In fact, all signals can be expressed as a superposition of sinusoids. 

As this story unfolds, we'll see that information systems rely heavily on spectral ideas. For example, 
radio, television, and cellular telephones transmit over different portions of the spectrum. In fact, spectrum 
is so important that communications systems are regulated as to which portions of the spectrum they can 
use by the Federal Communications Commission in the United States and by International Treaty for the 
world (see Frequency Allocations 20 ). Calculating the spectrum is easy: The Fourier transform defines 
how we can find a signal's spectrum. 

1.4.2 Complex Fourier Series 21 

In an earlier module 22 , we showed that a square wave could be expressed as a superposition of pulses. As 
useful as this decomposition was in this example, it does not generalize well to other periodic signals: How 
can a superposition of pulses equal a smooth signal like a sinusoid? Because of the importance of sinusoids 
to linear systems, you might wonder whether they could be added together to represent a large number of 
periodic signals. You would be right and in good company as well. Euler 23 and Gauss 24 in particular worried 
about this problem, and Jean Baptiste Fourier 25 got the credit even though tough mathematical issues were 
not settled until later. They worked on what is now known as the Fourier series: representing any periodic 
signal as a superposition of sinusoids. 

But the Fourier series goes well beyond being another signal decomposition method. Rather, the Fourier 
series begins our journey to appreciate how a signal can be described in either the time-domain or the 
frequency-domain with no compromise. Let s (£) be a periodic signal with period T. We want to show 
that periodic signals, even those that have constant-valued segments like a square wave, can be expressed 
as sum of harmonically related sine waves: sinusoids having frequencies that are integer multiples of 
the fundamental frequency. Because the signal has period T, the fundamental frequency is ^. The 
complex Fourier series expresses the signal as a superposition of complex exponentials having frequencies ^ , 
* = {..., -1,0,1,...}. 

oo 

s(t)= y, c * e ^ ( L87 ) 

k — — oo 

with Ck = 2 i a k — ibk)- The real and imaginary parts of the Fourier coefficients Ck are written in this 
unusual way for convenience in defining the classic Fourier series. The zeroth coefficient equals the signal's 
average value and is real- valued for real- valued signals: Co = ao- The family of functions < e l ^r~ > are called 



19 This content is available online at <http://cnx.Org/content/m0038/2.10/>. 

20 "Frequency Allocations" <http://cnx.org/content/m0083/latest/> 

21 This content is available online at <http://cnx.Org/content/m0042/2.31/>. 

22 "Signal Decomposition", Exercise 1 <http://cnx.0rg/content/mOOO8/latest/#swsuper> 

23 http:// www-groups. dcs. st- and.ac.uk/~history/Mathematicians/Euler.html 

24 http:// www-groups. dcs. st- and.ac.uk/~history/Mathematicians/Guass.html 

25 http:// www-groups. dcs. st- and.ac.uk/~history/Mathematicians/Fourier.html 
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basis functions and form the foundation of the Fourier series. No matter what the periodic signal might 
be, these functions are always present and form the representation's building blocks. They depend on the 
signal period T, and are indexed by k. 

Key point: Assuming we know the period, knowing the Fourier coefficients is equivalent to 
knowing the signal. Thus, it makes not difference if we have a time-domain or a frequency- domain 
characterization of the signal. 

Exercise 1.4.2.1 (Solution on p. 140.) 

What is the complex Fourier series for a sinusoid? 

To find the Fourier coefficients, we note the orthogonality property 

,- 2-jvkt ( -\ 2-Tvlt \ 1 it K = t / 

e *— e (- 8 )T-di= ^ (1.88) 

! if k / I 

Assuming for the moment that the complex Fourier series "works," we can find a signal's complex Fourier 
coefficients, its spectrum, by exploiting the orthogonality properties of harmonically related complex expo- 
nentials. Simply multiply each side of (1.87) by e~( l27Tlt * > and integrate over the interval [0,T]. 



c = T Jo s (*) dt 



(1.89) 



Example 1.11 

Finding the Fourier series coefficients for the square wave sq T (t) is very simple. Mathematically, 
this signal can be expressed as 

. 1 if < t < \ 
sqr (t)={ T 2 

-1 if f <t<T 

The expression for the Fourier coefficients has the form 

— T 

1 f 2 ( i 27 L kt\ 1 I fl 2irkt \ 

c fc =-y e-(^)dt--J T e-( l ^)dt (1.90) 



note: When integrating an expression containing i, treat it just like any other constant. 

The two integrals are very similar, one equaling the negative of the other. The final expression 
becomes 

h = s& (("I)* - 1 ) 

jh if fcodd ( L91 ) 

if A: even 
Thus, the complex Fourier series for the square wave is 

*(*)= E ^^ d-92) 

fee{...,-3,-i,i,3,...} 

Consequently, the square wave equals a sum of complex exponentials, but only those having 
frequencies equal to odd multiples of the fundamental frequency ^. The coefficients decay slowly 
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as the frequency index k increases. This index corresponds to the fc-th harmonic of the signal's 
period. 

A signal's Fourier series spectrum Ck has interesting properties. 

Property 1.1: 

If s (t) is real, Ck = ~c~k (real- valued periodic signals have conjugate-symmetric spectra). 

This result follows from the integral that calculates the Ck from the signal. Furthermore, this result means 
that 5R(cfe) = 5R(c_fc): The real part of the Fourier coefficients for real-valued signals is even. Similarly, 
^ (cfe) = — 9(c_fe): The imaginary parts of the Fourier coefficients have odd symmetry. Consequently, if 
you are given the Fourier coefficients for positive indices and zero and are told the signal is real-valued, you 
can find the negative-indexed coefficients, hence the entire spectrum. This kind of symmetry, Ck = C-k, is 
known as conjugate symmetry. 

Property 1.2: 

If s (— t) = s (t), which says the signal has even symmetry about the origin, c_j, = c^,. 

Given the previous property for real- valued signals, the Fourier coefficients of even signals are real- valued. 
A real-valued Fourier expansion amounts to an expansion in terms of only cosines, which is the simplest 
example of an even signal. 

Property 1.3: 

If s (— t) = —s (t), which says the signal has odd symmetry, c^j, = — c^. 

Therefore, the Fourier coefficients are purely imaginary. The square wave is a great example of an 
odd-symmetric signal. 

Property 1.4: 

The spectral coefficients for a periodic signal delayed by r, s (t — r), are c^e r - , where Ck denotes 
the spectrum of s (t). Delaying a signal by r seconds results in a spectrum having a linear phase 
shift of — ^^ in comparison to the spectrum of the undelayed signal. Note that the spectral 
magnitude is unaffected. Showing this property is easy. 
Proof: 

Note that the range of integration extends over a period of the integrand. Consequently, it should 
not matter how we integrate over a period, which means that J_ r (•) dt = L (•) dt, and we have 
our result. 

The complex Fourier series obeys Parseval's Theorem, one of the most important results in signal 
analysis. This general mathematical result says you can calculate a signal's power in either the time domain 
or the frequency domain. 

Theorem 1.1: Parseval's Theorem 

Average power calculated in the time domain equals the power calculated in the frequency domain. 



l f j s\t)dt= f; (| Cfe |) 2 (1.94) 



fe=-oo 



This result is a (simpler) re-expression of how to calculate a signal's power than with the real- valued 
Fourier series expression for power. 

Let's calculate the Fourier coefficients of the periodic pulse signal shown here (Figure 1.40). 



A p(t) 
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k-A-^ 



Figure 1.40: Periodic pulse signal. 



-►t 



The pulse width is A, the period T, and the amplitude A. The complex Fourier spectrum of this signal 
is given by 



1 



Ck 



A 



Ae T dt 



i2irk V 



1 



At this point, simplifying this expression requires knowing an interesting property. 

'0 s 



1 



-(* 



j0 / i0 _i0_\ 

2 I e 2 - e 2 J 



e 2 2isin 



Armed with this result, we can simply express the Fourier series coefficients for our pulse sequence. 



Cfc = Ae" 



ixfcA sin 



m 



(1.95) 



Because this signal is real- valued, we find that the coefficients do indeed have conjugate symmetry: Ck = c~k- 
The periodic pulse signal has neither even nor odd symmetry; consequently, no additional symmetry exists 
in the spectrum. Because the spectrum is complex valued, to plot it we need to calculate its magnitude and 
phase. 



' 7rfcA N 



Ck 



nk 



(1.96) 



^(c*) 



TrfcA /sin(^) 

T \ irk 



7rneg 



sign (k) 



The function neg(-) equals -1 if its argument is negative and zero otherwise. The somewhat complicated 
expression for the phase results because the sine term can be negative; magnitudes must be positive, leaving 
the occasional negative values to be accounted for as a phase shift of w. 
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Periodic Pulse Sequence 
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Figure 1.41: The magnitude and phase of the periodic pulse sequence's spectrum is shown for positive- 
frequency indices. Here -^ — 0.2 and A — 1. 



Also note the presence of a linear phase term (the first term in Z (c&) is proportional to frequency y). 
Comparing this term with that predicted from delaying a signal, a delay of 4 is present in our signal. 
Advancing the signal by this amount centers the pulse about the origin, leaving an even signal, which in 
turn means that its spectrum is real- valued. Thus, our calculated spectrum is consistent with the properties 
of the Fourier spectrum. 

Exercise 1.4.2.2 (Solution on p. 140.) 

What is the value of cq? Recalling that this spectral coefficient corresponds to the signal's average 
value, does your answer make sense? 

The phase plot shown in Figure 1.41 (Periodic Pulse Sequence) requires some explanation as it does not 
seem to agree with what (1.96) suggests. There, the phase has a linear component, with a jump of tt every 
time the sinusoidal term changes sign. We must realize that any integer multiple of 2tt can be added to a 
phase at each frequency without affecting the value of the complex spectrum. We see that at frequency 
index 4 the phase is nearly — tt. The phase at index 5 is undefined because the magnitude is zero in this 
example. At index 6, the formula suggests that the phase of the linear term should be less than (more 
negative) than — tt. In addition, we expect a shift of —tt in the phase between indices 4 and 6. Thus, the 
phase value predicted by the formula is a little less than — (2ir). Because we can add 2tt without affecting 
the value of the spectrum at index 6, the result is a slightly negative number as shown. Thus, the formula 
and the plot do agree. In phase calculations like those made in MATLAB, values are usually confined to the 
range [—tt, tt) by adding some (possibly negative) multiple of 2tt to each phase value. 
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1,4,3 Classic Fourier Series 26 

The classic Fourier series as derived originally expressed a periodic signal (period T) in terms of harmonically 
related sines and cosines. 

^ {2nkt\ v^ /27rfcA 

s (t) = a + ^ a fc cos I — - I + 2^ OfeSin I — - I (1.97) 

fe=i ^ ' fe=i ^ ' 

The complex Fourier series and the sine-cosine series are identical, each representing a signal's 
spectrum. The Fourier coefficients, a,k and bk, express the real and imaginary parts respectively of the 
spectrum while the coefficients Ck of the complex Fourier series express the spectrum as a magnitude and 
phase. Equating the classic Fourier series (1.97) to the complex Fourier series (1.87), an extra factor of two 
and complex conjugate become necessary to relate the Fourier coefficients in each. 

Cfc = - (afe - ib k ) 

Exercise 1.4.3.1 (Solution on p. 140.) 

Derive this relationship between the coefficients of the two Fourier series. 

Just as with the complex Fourier series, we can find the Fourier coefficients using the orthogonality 
properties of sinusoids. Note that the cosine and sine of harmonically related frequencies, even the same 
frequency, are orthogonal. 

\/k,l,keZleZ: ( / sin ( -^— J cos ( — j dt = J (1.98) 

' ' 2-Kkt\ ^ { 2nlt\ ^ j | if (k = l) A (k ± 0) A (1^0) 



sin sin dt 



L 



/2nkt\ (2-kU\ . 
cos I — I cos I ) dt 



if (k^l) V (k = = I) 



f if (k = l) A (k ^ 0) A {l^ 0) 
T if k = = I 



if k^l 
These orthogonality relations follow from the following important trigonometric identities. 

sin (a) sin (/?) = | (cos (a — (3) — cos (a + /?)) 

cos (a) cos (/3) = \ (cos (a + 0) + cos (a - (3)) (1.99) 

sin (a) cos (/?) = | (sin (a + 0) + sin (a — (3j) 

These identities allow you to substitute a sum of sines and/or cosines for a product of them. Each term in 
the sum can be integrating by noticing one of two important properties of sinusoids. 



• 



The integral of a sinusoid over an integer number of periods equals zero. 
The integral of the square of a unit-amplitude sinusoid over a period T equals 



To use these, let's, for example, multiply the Fourier series for a signal by the cosine of the I th harmonic 
cos (^f^) and integrate. The idea is that, because integration is linear, the integration will sift out all but 
the term involving a;. 



/o s (£) cos (^) dt = Jo a cos (^) dt + ZT=i a k / cos (W) cos (¥*) dt + ( L10 °) 
EZih J T sin (^) cos (^)dt 



6 This content is available online at <http://cnx.Org/content/m0039/2.23/>. 
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The first and third terms are zero; in the second, the only non-zero term in the sum results when the 
indices k and I are equal (but not zero), in which case we obtain ^-. If k = = I, we obtain a^T. 
Consequently, 

\/l,l^0:lai = ^J s (t) cos (^)dt) 
All of the Fourier coefficients can be found similarly. 

a o = T Jo s (*) dt 



Vfc, fc + : (o fc = | / T s (t) cos (^) dt) (1.101) 

&fc = f / T s(i)sin(^)cft 

Exercise 1.4.3.2 (Solution on p. 140.) 

The expression for ao is referred to as the average value of s (t). Why? 

Exercise 1.4.3.3 (Solution on p. 140.) 

What is the Fourier series for a unit-amplitude square wave? 

Example 1.12 

Let's find the Fourier series representation for the half- wave rectified sinusoid. 

, sin(^) if 0<t< f , 
8(t)={ KT > ~ 2 (1.102) 

if \ < t < T 

Begin with the sine terms in the series; to find 6^ we must calculate the integral 

2 n /2ttA {2nkt\ 
bk=^j sin i^—j sin (^ — J dt (1.103) 

Using our trigonometric identities turns our integral of a product of sinusoids into a sum of integrals 
of individual sinusoids, which are much easier to evaluate. 



/ * sin (^) sin (3^) eft = * J* cos (**£*) 



27r(fc+l)t 
T 



i if k = 1 (1-104) 



otherwise 
Thus, 

2 



On to the cosine terms. The average value, which corresponds to ao, equals —. The remainder 
of the cosine coefficients are easy to find, but yield the complicated result 

' if kodd 

Thus, the Fourier series for the half-wave rectified sinusoid has non-zero terms for the average, 
the fundamental, and the even harmonics. 
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1.4,4 A Signal's Spectrum 27 

A periodic signal, such as the half-wave rectified sinusoid, consists of a sum of elemental sinusoids. A plot 
of the Fourier coefficients as a function of the frequency index, such as shown in Figure 1.42 (Fourier Series 
spectrum of a half-wave rectified sine wave), displays the signal's spectrum. The word "spectrum" implies 
that the independent variable, here k, corresponds somehow to frequency. Each coefficient is directly related 
to a sinusoid having a frequency of ^. Thus, if we half- wave rectified a 1 kHz sinusoid, k = 1 corresponds 
to 1 kHz, k = 2 to 2 kHz, etc. 



Fourier Series spectrum of a half-wave rectified sine wave 
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Figure 1.42: The Fourier series spectrum of a half-wave rectified sinusoid is shown. The index indicates 
the multiple of the fundamental frequency at which the signal has energy. 



A subtle, but very important, aspect of the Fourier spectrum is its uniqueness: You can unambiguously 
find the spectrum from the signal (decomposition (1.101)) and the signal from the spectrum (composition). 
Thus, any aspect of the signal can be found from the spectrum and vice versa. A signal's frequency 
domain expression is its spectrum. A periodic signal can be defined either in the time domain (as a 
function) or in the frequency domain (as a spectrum). 

A fundamental aspect of solving electrical engineering problems is whether the time or frequency domain 
provides the most understanding of a signal's properties and the simplest way of manipulating it. The 
uniqueness property says that either domain can provide the right answer. As a simple example, suppose 
we want to know the (periodic) signal's maximum value. Clearly the time domain provides the answer 
directly. To use a frequency domain approach would require us to find the spectrum, form the signal from 
the spectrum and calculate the maximum; we're back in the time domain! 

Another feature of a signal is its average power. A signal's instantaneous power is defined to be its 
square. The average power is the average of the instantaneous power over some time interval. For a periodic 
signal, the natural time interval is clearly its period; for nonperiodic signals, a better choice would be entire 
time or time from onset. For a periodic signal, the average power is the square of its root-mean-squared 



7 This content is available online at <http://cnx.Org/content/m0040/2.21/> . 
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(rms) value. We define the rms value of a periodic signal to be 

rms (s) = 
and thus its average power is 



TJo 



s 2 (t) dt 



power (s) = rms 2 (s) 

= ir 

T JO 



1 /o T « a (*)d* 



(1.106) 

(1.107) 
(Solution on p. 140.) 



Exercise 1.4.4.1 

What is the rms value of the half-wave rectified sinusoid? 

To find the average power in the frequency domain, we need to substitute the spectral representation of the 
signal into this expression. 



power (s) 



1 f T ( °° 



afccos 



2irkt 

T 



Y^ ^ si 



fc=i 



2-irkf 
~T r ~ , 



dl 



The square inside the integral will contain all possible pairwise products. However, the orthogonality proper- 
ties (1.98) say that most of these crossterms integrate to zero. The survivors leave a rather simple expression 
for the power we seek. 



power (s) = a Q 2 + - ^ a k 2 + bk 



(1.108) 



fe=i 
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Figure 1.43: Power spectrum of a half-wave rectified sinusoid. 



It could well be that computing this sum is easier than integrating the signal's square. Furthermore, 
the contribution of each term in the Fourier series toward representing the signal can be measured by its 
contribution to the signal's average power. Thus, the power contained in a signal at its fcth harmonic is 

2 , . 2 

Qfc "J k . The power spectrum, P s (k), such as shown in Figure 1.43 (Power Spectrum of a Half- Wave 
Rectified Sinusoid), plots each harmonic's contribution to the total power. 
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Exercise 1.4.4.2 (Solution on p. 140.) 

In high-end audio, deviation of a sine wave from the ideal is measured by the total harmonic 
distortion, which equals the total power in the harmonics higher than the first compared to power 
in the fundamental. Find an expression for the total harmonic distortion for any periodic signal. 
Is this calculation most easily performed in the time or frequency domain? 



1,4,5 Fourier Series Approximation of Signals 28 

It is interesting to consider the sequence of signals that we obtain as we incorporate more terms into the 
Fourier series approximation of the half-wave rectified sine wave (Example 1.12). Define sk (t) to be the 
signal containing K + 1 Fourier terms. 

''' ^TrfcA J^, . f2irkt 



sk (t) = a + 2_^ afecos I -—- I + ^ b k sm I -—- I (1.109) 



fe=i v " ' fe=i 



Figure 1.44 ( Fourier Series spectrum of a half- wave rectified sine wave ) shows how this sequence of signals 
portrays the signal more accurately as more terms are added. 



s This content is available online at <http://cnx.Org/content/ml0687/2.10/>. 
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Fourier Series spectrum of a half-wave rectified sine wave 
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Figure 1.44: The Fourier series spectrum of a half- wave rectified sinusoid is shown in the upper 
portion. The index indicates the multiple of the fundamental frequency at which the signal has energy. 
The cumulative effect of adding terms to the Fourier series for the half-wave rectified sine wave is shown 
in the bottom portion. The dashed line is the actual signal, with the solid line showing the finite series 
approximation to the indicated number of terms, K + 1. 



We need to assess quantitatively the accuracy of the Fourier series approximation so that we can judge 
how rapidly the series approaches the signal. When we use a K + 1-term series, the error — the difference 



between the signal and the K + 1-term series — corresponds to the unused terms from the series. 



«(*) 



/ J a k cos 

k=K+l 



2irkt 



^ (2irkt\ 

1^ hsm\ — 
k=K+l x ' 



51 



(1.110) 



To find the rms error, we must square this expression and integrate it over a period. Again, the integral of 
most cross-terms is zero, leaving 



rms (e^) 



\ 



£ 

k=K+l 



a^ 



bk 



(1.111) 



Figure 1.45 (Approximation error for a half- wave rectified sinusoid) shows how the error in the Fourier series 
for the half-wave rectified sinusoid decreases as more terms are incorporated. In particular, the use of four 
terms, as shown in the bottom plot of Figure 1.44 ( Fourier Series spectrum of a half-wave rectified sine 
wave ), has a rms error (relative to the rms value of the signal) of about 3%. The Fourier series in this case 
converges quickly to the signal. 
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Figure 1.45: The rms error calculated according to (1.111) is shown as a function of the number of 
terms in the series for the half-wave rectified sinusoid. The error has been normalized by the rms value 
of the signal. 



We can look at Figure 1.46 (Power spectrum and approximation error for a square wave) to see the power 
spectrum and the rms approximation error for the square wave. 
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Power spectrum and approximation error for a square wave 
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Figure 1.46: The upper plot shows the power spectrum of the square wave, and the lower plot the 
rms error of the finite-length Fourier series approximation to the square wave. The asterisk denotes the 
rms error when the number of terms K in the Fourier series equals 99. 



Because the Fourier coefficients decay more slowly here than for the half-wave rectified sinusoid, the rms 
error is not decreasing quickly. Said another way, the square- wave's spectrum contains more power at higher 
frequencies than does the half-wave-rectified sinusoid. This difference between the two Fourier series results 
because the half-wave rectified sinusoid's Fourier coefficients are proportional to A- while those of the square 
wave are proportional to jk If fact, after 99 terms of the square wave's approximation, the error is bigger 
than 10 terms of the approximation for the half-wave rectified sinusoid. Mathematicians have shown that 
no signal has an rms approximation error that decays more slowly than it does for the square wave. 

Exercise 1.4.5.1 (Solution on p. 140.) 

Calculate the harmonic distortion for the square wave. 

More than just decaying slowly, Fourier series approximation shown in Figure 1.47 (Fourier series approxi- 
mation of a square wave) exhibits interesting behavior. 
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Fourier series approximation of a square wave 




Figure 1.47: Fourier series approximation to sq(f). The number of terms in the Fourier sum is 
indicated in each plot, and the square wave is shown as a dashed line over two periods. 



Although the square wave's Fourier series requires more terms for a given representation accuracy, when 
comparing plots it is not clear that the two are equal. Does the Fourier series really equal the square wave 
at all values of i? In particular, at each step-change in the square wave, the Fourier series exhibits a peak 
followed by rapid oscillations. As more terms are added to the series, the oscillations seem to become more 
rapid and smaller, but the peaks are not decreasing. For the Fourier series approximation for the half-wave 
rectified sinusoid (Figure 1.44: Fourier Series spectrum of a half-wave rectified sine wave ), no such behavior 
occurs. What is happening? 

Consider this mathematical question intuitively: Can a discontinuous function, like the square wave, be 
expressed as a sum, even an infinite one, of continuous signals? One should at least be suspicious, and in 
fact, it can't be thus expressed. This issue brought Fourier 29 much criticism from the French Academy of 
Science (Laplace, Lagrange, Monge and LaCroix comprised the review committee) for several years after its 
presentation on 1807. It was not resolved for also a century, and its resolution is interesting and important 
to understand from a practical viewpoint. 



3 http:// www-groups. dcs.st-and.ac.uk/~history/Mathematicians/Fourier. html 
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The extraneous peaks in the square wave's Fourier series never disappear; they are termed Gibb's 
phenomenon after the American physicist Josiah Willard Gibbs. They occur whenever the signal is dis- 
continuous, and will always be present whenever the signal has jumps. 

Let's return to the question of equality; how can the equal sign in the definition of the Fourier series be 
justified? The partial answer is that pointwise — each and every value of t — equality is not guaranteed. 
However, mathematicians later in the nineteenth century showed that the rms error of the Fourier series was 
always zero. 

limit rms (ck) = 

What this means is that the error between a signal and its Fourier series approximation may not be zero, but 
that its rms value will be zero! It is through the eyes of the rms value that we redefine equality: The usual 
definition of equality is called pointwise equality: Two signals s\ (t), S2 (t) are said to be equal pointwise 
if si (£) = S2 (t) for all values of t. A new definition of equality is mean-square equality: Two signals 
are said to be equal in the mean square if rms (si — s 2 ) = 0. For Fourier series, Gibb's phenomenon peaks 
have finite height and zero width. The error differs from zero only at isolated points — whenever the periodic 
signal contains discontinuities — and equals about 9% of the size of the discontinuity. The value of a function 
at a finite set of points does not affect its integral. This effect underlies the reason why defining the value of 
a discontinuous function, like we refrained from doing in defining the step function 30 , at its discontinuity is 
meaningless. Whatever you pick for a value has no practical relevance for either the signal's spectrum or for 
how a system responds to the signal. The Fourier series value "at" the discontinuity is the average of the 
values on either side of the jump. 

1.4.6 Encoding Information in the Frequency Domain 31 

To emphasize the fact that every periodic signal has both a time and frequency domain representation, we can 
exploit both to encode information into a signal. Refer to the Fundamental Model of Communication 32 . 
We have an information source, and want to construct a transmitter that produces a signal x(t). For the 
source, let's assume we have information to encode every T seconds. For example, we want to represent 
typed letters produced by an extremely good typist (a key is struck every T seconds). Let's consider the 
complex Fourier series formula in the light of trying to encode information. 

K 



- , \ ^ *' 2 7Tfet / ^ 



k=-K 

We use a finite sum here merely for simplicity (fewer parameters to determine). An important aspect of 
the spectrum is that each frequency component Ck can be manipulated separately: Instead of finding the 
Fourier spectrum from a time-domain specification, let's construct it in the frequency domain by selecting 
the Cfc according to some rule that relates coefficient values to the alphabet. In defining this rule, we want 
to always create a real-valued signal x(t). Because of the Fourier spectrum's properties (Property 1.1, p. 
42), the spectrum must have conjugate symmetry. This requirement means that we can only assign positive- 
indexed coefficients (positive frequencies), with negative-indexed ones equaling the complex conjugate of the 
corresponding positive- indexed ones. 

Assume we have N letters to encode: {oi, . . . , a^}. One simple encoding rule could be to make a single 
Fourier coefficient be non-zero and all others zero for each letter. For example, if a n occurs, we make c„ = 1 
and Cfe = 0, k ^ n. In this way, the n th harmonic of the frequency ^ is used to represent a letter. Note 
that the bandwidth — the range of frequencies required for the encoding — equals ^. Another possibility is 
to consider the binary representation of the letter's index. For example, if the letter a^ occurs, converting 



30 "Elemental Signals": Section Unit Step <http://cnx.Org/content/m0004/latest/#stepdef> 
31 This content is available online at <http://cnx.Org/content/m0043/2.17/>. 
32 "Structure of Communication Systems", Figure 1: Fundamental model of communication 
<http://cnx.Org/content/m0002/latest/#commsys> 
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13 to its base 2 representation, we have 13 = 11012- We can use the pattern of zeros and ones to represent 
directly which Fourier coefficients we "turn on" (set equal to one) and which we "turn off." 

Exercise 1.4.6.1 (Solution on p. 140.) 

Compare the bandwidth required for the direct encoding scheme (one nonzero Fourier coefficient 
for each letter) to the binary number scheme. Compare the bandwidths for a 128-letter alphabet. 
Since both schemes represent information without loss - we can determine the typed letter uniquely 
from the signal's spectrum - both are viable. Which makes more efficient use of bandwidth and 
thus might be preferred? 

Exercise 1.4.6.2 (Solution on p. 141.) 

Can you think of an information-encoding scheme that makes even more efficient use of the 
spectrum? In particular, can we use only one Fourier coefficient to represent N letters uniquely? 

We can create an encoding scheme in the frequency domain (p. 54) to represent an alphabet of letters. But, 
as this information-encoding scheme stands, we can represent one letter for all time. However, we note that 
the Fourier coefficients depend only on the signal's characteristics over a single period. We could change 
the signal's spectrum every T as each letter is typed. In this way, we turn spectral coefficients on and off 
as letters are typed, thereby encoding the entire typed document. For the receiver (see the Fundamental 
Model of Communication 33 ) to retrieve the typed letter, it would simply use the Fourier formula for the 
complex Fourier spectrum 34 for each T-second interval to determine what each typed letter was. Figure 1.48 
(Encoding Signals) shows such a signal in the time-domain. 



Encoding Signals 



iU(t) 




► t 



Figure 1.48: The encoding of signals via the Fourier spectrum is shown over three "periods." In 
this example, only the third and fourth harmonics are used, as shown by the spectral magnitudes corre- 
sponding to each T-second interval plotted below the waveforms. Can you determine the phase of the 
harmonics from the waveform? 



33 "Structure of Communication Systems", Figure 1: Fundamental model of communication 
<http://cnx.Org/content/m0002/latest/#commsys> 
34 "Complex Fourier Series and Their Properties", (2) <http://cnx.Org/content/m0065/latest/#complex> 
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In this Fourier-series encoding scheme, we have used the fact that spectral coefficients can be indepen- 
dently specified and that they can be uniquely recovered from the time-domain signal over one "period." Do 
note that the signal representing the entire document is no longer periodic. By understanding the Fourier se- 
ries' properties (in particular that coefficients are determined only over a T-second interval, we can construct 
a communications system. This approach represents a simplification of how modern modems represent text 
that they transmit over telephone lines. 

1.4.7 Filtering Periodic Signals 35 

The Fourier series representation of a periodic signal makes it easy to determine how a linear, time-invariant 
filter reshapes such signals in general. The fundamental property of a linear system is that its input-output 
relation obeys superposition: L (oiSi (t) + a 2 s 2 (£)) = a x L (s\ (£)) + a 2 L (s 2 (£)). Because the Fourier series 
represents a periodic signal as a linear combination of complex exponentials, we can exploit the superposition 
property. Furthermore, we found for linear circuits that their output to a complex exponential input is just the 
frequency response evaluated at the signal's frequency times the complex exponential. Said mathematically, 
if x (t) = e l ^^~ , then the output y (t) = H (^) e l ^r~ because / = £. Thus, if x(t) is periodic thereby 
having a Fourier series, a linear circuit's output to this signal will be the superposition of the output to each 
component. 

y(t)= Y, c k Hl-\e^ (1.113) 

fc=-oo ^ ' 

Thus, the output has a Fourier series, which means that it too is periodic. Its Fourier coefficients equal 
CkH (|i). To obtain the spectrum of the output, we simply multiply the input spectrum by 
the frequency response . The circuit modifies the magnitude and phase of each Fourier coefficient. Note 
especially that while the Fourier coefficients do not depend on the signal's period, the circuit's transfer 
function does depend on frequency, which means that the circuit's output will differ as the period varies. 



5 This content is available online at <http://cnx.Org/content/m0044/2.ll/>. 
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Filtering a periodic signal 
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Figure 1.49: A periodic pulse signal, such as shown on the left part (^ = 0.2), serves as the input to 
an RC lowpass filter. The input's period was 1 ms (millisecond). The filter's cutoff frequency was set to 
the various values indicated in the top row, which display the output signal's spectrum and the filter's 
transfer function. The bottom row shows the output signal derived from the Fourier series coefficients 
shown in the top row. (a) Periodic pulse signal (b) Top plots show the pulse signal's spectrum for various 
cutoff frequencies. Bottom plots show the filter's output signals. 



Example 1.13 

The periodic pulse signal shown on the left above serves as the input to a .RC-circuit that has the 
transfer function (calculated elsewhere 36 ) 



H(f) 



1 



1 + i2nfRC 



(1.114) 



Figure 1.49 (Filtering a periodic signal) shows the output changes as we vary the filter's cutoff 
frequency. Note how the signal's spectrum extends well above its fundamental frequency. Having 
a cutoff frequency ten times higher than the fundamental does perceptibly change the output 
waveform, rounding the leading and trailing edges. As the cutoff frequency decreases (center, then 
left), the rounding becomes more prominent, with the leftmost waveform showing a small ripple. 



36 "Transfer Functions", Figure 2: Magnitude and phase of the transfer function 
<http://cnx.Org/content/m0028/latest/#magphase> 
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Exercise 1.4.7.1 (Solution on p. 141.) 

What is the average value of each output waveform? The correct answer may surprise you. 

This example also illustrates the impact a lowpass filter can have on a waveform. The simple RC filter used 
here has a rather gradual frequency response, which means that higher harmonics are smoothly suppressed. 
Later, we will describe filters that have much more rapidly varying frequency responses, allowing a much 
more dramatic selection of the input's Fourier coefficients. 

More importantly, we have calculated the output of a circuit to a periodic input without writing, 
much less solving, the differential equation governing the circuit's behavior. Furthermore, we made these 
calculations entirely in the frequency domain. Using Fourier series, we can calculate how any linear circuit 
will respond to a periodic input. 

1.4.8 Derivation of the Fourier Transform 37 

Fourier series clearly open the frequency domain as an interesting and useful way of determining how circuits 
and systems respond to periodic input signals. Can we use similar techniques for nonperiodic signals? What 
is the response of the filter to a single pulse? Addressing these issues requires us to find the Fourier spectrum 
of all signals, both periodic and nonperiodic ones. We need a definition for the Fourier spectrum of a signal, 
periodic or not. This spectrum is calculated by what is known as the Fourier transform. 

Let st {t) be a periodic signal having period T. We want to consider what happens to this signal's 
spectrum as we let the period become longer and longer. We denote the spectrum for any assumed value of 
the period by c& (T). We calculate the spectrum according to the familiar formula 

T 

c k (T) = ^J 2 TST (t)e- 1 ^ M dt (1.115) 

where we have used a symmetric placement of the integration interval about the origin for subsequent deriva- 
tional convenience. Let / be a fixed frequency equaling ^; we vary the frequency index k proportionally as 
we increase the period. Define 

S T (/) = Tc k (T) = J ^ s T (t) e-^'Wdt (1.116) 

making the corresponding Fourier series 

CO ^ 

s T (t)= Y, ST(f)e i2 ^- (1.117) 

k— — oo 

As the period increases, the spectral lines become closer together, becoming a continuum. Therefore, 

/>oo 

i2nft 

T ^°° J-oo 

with 



limit a T (t) = a(t)= / S{f)e l ^ lt df (1.118) 

T^oo ./_«, 



S(f)= / s{t)e-^ ft *>dt (1.119) 



S (/) is the Fourier transform of s (t) (the Fourier transform is symbolically denoted by the uppercase 
version of the signal's symbol) and is defined for any signal for which the integral ((1.119)) converges. 

Example 1.14 

Let's calculate the Fourier transform of the pulse signal 38 , p(t). 

P(f) = f°° p(t) e-^^dt = f e-^f^dt = — - ( e -(^/ A ) - l) 



oo JO 



37 This content is available online at <http://cnx.Org/content/m0046/2.21/>. 

38 "Elemental Signals": Section Pulse <http://cnx.Org/content/m0004/latest/#pulsedef> 
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P(f) 



3 -(^/A): 



7T/ 



Note how closely this result resembles the expression for Fourier series coefficients of the periodic 
pulse signal (1.96). 
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Figure 1.50: The upper plot shows the magnitude of the Fourier series spectrum for the case of T — 1 
with the Fourier transform of p (t) shown as a dashed line. For the bottom panel, we expanded the period 
to T — 5, keeping the pulse's duration fixed at 0.2, and computed its Fourier series coefficients. 



Figure 1.50 (Spectrum) shows how increasing the period does indeed lead to a continuum of coefficients, 



and that the Fourier transform does correspond to what the continuum becomes. The quantity 



sin(i) 



has a 



special name, the sine (pronounced "sink") function, and is denoted by sinc(t). Thus, the magnitude of the 
pulse's Fourier transform equals |Asinc(7r/A) |. 

The Fourier transform relates a signal's time and frequency domain representations to each other. The 
direct Fourier transform (or simply the Fourier transform) calculates a signal's frequency domain representa- 
tion from its time-domain variant ((1.120)). The inverse Fourier transform ((1.121)) finds the time-domain 
representation from the frequency domain. Rather than explicitly writing the required integral, we often 
symbolically express these transform calculations as T (s) and T~ Y (S), respectively. 



^00 = s(f) 

= J. 8(t)e-<- i2 *Wdt 



(1.120) 
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v y w (1.121) 

We must have s (t) = T~ x [T (s (£))) and S (f) = T {T~ x (S (/))) , and these results are indeed valid with 
minor exceptions. 

note: Recall that the Fourier series for a square wave gives a value for the signal at the dis- 
continuities equal to the average value of the jump. This value may differ from how the signal is 
defined in the time domain, but being unequal at a point is indeed minor. 

Showing that you "get back to where you started" is difficult from an analytic viewpoint, and we won't try 
here. Note that the direct and inverse transforms differ only in the sign of the exponent. 

Exercise 1.4.8.1 (Solution on p. 141.) 

The differing exponent signs means that some curious results occur when we use the wrong sign. 
What is T (S (/))? In other words, use the wrong exponent sign in evaluating the inverse Fourier 
transform. 

Properties of the Fourier transform and some useful transform pairs are provided in the accompanying 
tables (Table 1.1: Short Table of Fourier Transform Pairs and Table 1.2: Fourier Transform Properties). 
Especially important among these properties is Parseval's Theorem, which states that power computed 
in either domain equals the power in the other. 

/oo 
(\S(f)\fdf (1.122) 

Of practical importance is the conjugate symmetry property: When s (t) is real-valued, the spectrum at 
negative frequencies equals the complex conjugate of the spectrum at the corresponding positive frequencies. 
Consequently, we need only plot the positive frequency portion of the spectrum (we can easily determine the 
remainder of the spectrum). 

Exercise 1.4.8.2 (Solution on p. 141.) 

How many Fourier transform operations need to be applied to get the original signal back: 
f(---(T(s))) = s(t)? 
Note that the mathematical relationships between the time domain and frequency domain versions of the 
same signal are termed transforms. We are transforming (in the nontechnical meaning of the word) a signal 
from one representation to another. We express Fourier transform pairs as s (t) <-» S(f). A signal's time 
and frequency domain representations are uniquely related to each other. A signal thus "exists" in both 
the time and frequency domains, with the Fourier transform bridging between the two. We can define an 
information carrying signal in either the time or frequency domains; it behooves the wise engineer to use the 
simpler of the two. 

A common misunderstanding is that while a signal exists in both the time and frequency domains, a single 
formula expressing a signal must contain only time or frequency: Both cannot be present simultaneously. 
This situation mirrors what happens with complex amplitudes in circuits: As we reveal how communications 
systems work and are designed, we will define signals entirely in the frequency domain without explicitly 
finding their time domain variants. This idea is shown in another module (Section 1.4.6) where we define 
Fourier series coefficients according to letter to be transmitted. Thus, a signal, though most familiarly defined 
in the time-domain, really can be defined equally as well (and sometimes more easily) in the frequency domain. 
For example, impedances depend on frequency and the time variable cannot appear. 

We will learn (Section 1.4.9) that finding a linear, time-invariant system's output in the time domain can 
be most easily calculated by determining the input signal's spectrum, performing a simple calculation in the 
frequency domain, and inverse transforming the result. Furthermore, understanding communications and 
information processing systems requires a thorough understanding of signal structure and of how systems 
work in both the time and frequency domains. 
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The only difficulty in calculating the Fourier transform of any signal occurs when we have periodic signals 
(in either domain). Realizing that the Fourier series is a special case of the Fourier transform, we simply 
calculate the Fourier series coefficients instead, and plot them along with the spectra of nonperiodic signals 
on the same frequency axis. 

Short Table of Fourier Transform Pairs 



a(t) 


s(f) 


e- {at ^u{t) 
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sin(7r/A) 
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( 1 if I/I < W 
S(f)={ '■" 

[ if |/| > W 



Table 1.1 
Fourier Transform Properties 





Time-Domain 


Frequency Domain 


Linearity 


Oi«i (t) + a 2 s 2 (t) 


OiSi (/) + a 2 5 2 (/) 


Conjugate Symmetry 


s(«)el 


S(f) = S(-f) 


Even Symmetry 


*(*) = *(-*) 


S(f) = S(-f) 


Odd Symmetry 


*(*) = -*(-*) 


S(f) = -S(-f) 


Scale Change 


s (at) 


\a-\ S {a) 


Time Delay 


S (t-T) 


e -(i2*fr) S (fl 


Complex Modulation 


e l27r/o *s (t) 


S(f-fo) 


Amplitude Modulation by Cosine 


s (t) cos (2irfoi) 


S(/-/o)+S(/+/ ) 
2 


Amplitude Modulation by Sine 


s (t) sin (27T/ t) 


S(f-fo)S(f+fo) 
2» 


Differentiation 


5-W 


i27T/S(/) 


Integration 


J" 8 (a) da 


^5(/)if5(0) = 


Multiplication by t 


ts(t) 


1 dS(/) 
-(i2ir) df 


Area 


/"»«(*)* 


5(0) 


Value at Origin 


*(0) 


JZo S (f)df 


Parseval's Theorem 


Hod^*)!) 2 * 


/~oo(|5(/)|) 2 4f 



Table 1.2 

Example 1.15 

In communications, a very important operation on a signal s (£) is to amplitude modulate it. 
Using this operation more as an example rather than elaborating the communications aspects here, 
we want to compute the Fourier transform — the spectrum — of 

(1 + s (*)) cos (2nf c t) 
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Thus, 

(1 + s (£)) cos (2tt/ c £) = cos (2tt/ c £) + s (t) cos (2nf c t) 

For the spectrum of cos (2tt f c t) , we use the Fourier series. Its period is -J-, and its only nonzero 
Fourier coefficients are c±\ = |. The second term is not periodic unless s (t) has the same period 
as the sinusoid. Using Euler's relation, the spectrum of the second term can be derived as 

/oo 
S (/) e^^df cos (2irf c t) 
-oo 

Using Euler's relation for the cosine, 

(s (t) cos (27r/ c t)) = - / 5 (/) e^+^df +- S(f) e^^^df 



(s (t) cos (2tt/ c *)) 



1 f 00 
5 (/ - /c) e l2T/t d/ + - / S (/ + / c ) e i2 ^df 



(S (t) COS (27T/ C t)) 



S(f-fc) + S(f + f c )„„ 



ft 



df 



Exploiting the uniqueness property of the Fourier transform, we have 



(1.123) 



This component of the spectrum consists of the original signal's spectrum delayed and advanced 
in frequency. The spectrum of the amplitude modulated signal is shown in Figure 1.51. 
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Figure 1.51: A signal which has a triangular shaped spectrum is shown in the top plot. Its highest 
frequency — the largest frequency containing power — is W Hz. Once amplitude modulated, the resulting 
spectrum has "lines" corresponding to the Fourier series components at ± (f c ) and the original triangular 
spectrum shifted to components at ± (/ c ) and scaled by |. 



Note how in this figure the signal s (t) is defined in the frequency domain. To find its time 
domain representation, we simply use the inverse Fourier transform. 

Exercise 1.4.8.3 (Solution on p. 141.) 

What is the signal s (t) that corresponds to the spectrum shown in the upper panel of Figure 1.51? 
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Exercise 1.4.8.4 (Solution on p. 141.) 

What is the power in x (t), the amplitude-modulated signal? Try the calculation in both the time 
and frequency domains. 

In this example, we call the signal s (t) a baseband signal because its power is contained at low frequencies. 
Signals such as speech and the Dow Jones averages are baseband signals. The baseband signal's bandwidth 
equals W, the highest frequency at which it has power. Since x (i)'s spectrum is confined to a frequency band 
not close to the origin (we assume f c 3> W), we have a bandpass signal. The bandwidth of a bandpass 
signal is not its highest frequency, but the range of positive frequencies where the signal has power. Thus, 
in this example, the bandwidth is 2WHz. Why a signal's bandwidth should depend on its spectral shape 
will become clear once we develop communications systems. 

1.4.9 Linear Time Invariant Systems 39 

When we apply a periodic input to a linear, time-invariant system, the output is periodic and has Fourier 
series coefficients equal to the product of the system's frequency response and the input's Fourier coefficients 
(Filtering Periodic Signals (1.113)). The way we derived the spectrum of non-periodic signal from periodic 
ones makes it clear that the same kind of result works when the input is not periodic: If x (t) serves as 
the input to a linear, time-invariant system having frequency response H (/), the spectrum of 
the output is X(f)H(f). 

Example 1.16 

Let's use this frequency-domain input-output relationship for linear, time-invariant systems to 
find a formula for the iZC-circuit's response to a pulse input. We have expressions for the input's 
spectrum and the system's frequency response. 

P(/ ) = e -(ftr/A) »infr/A) (1124) 

71"/ 

H(f)= — 4 tun ( L125 ) 

1 + i2njRC 

Thus, the output's Fourier transform equals 

ym = e -(i»/A) Sin(7r/A) 1 , . 

Uj " 6 -Kf l + i2irfRC [ ' 

You won't find this Fourier transform in our table, and the required integral is difficult to evaluate 
as the expression stands. This situation requires cleverness and an understanding of the Fourier 
transform's properties. In particular, recall Euler's relation for the sinusoidal term and note the 
fact that multiplication by a complex exponential in the frequency domain amounts to a time delay. 
Let's momentarily make the expression for Y (/) more complicated. 

e -(iirf A) sin(7r/A) = ( l7I f A) e '"/^_ e -('"/^) 

*f ' i2ir/ 11.121) 

= i (l - e -a^f^)) 

Consequently, 

Y{f) = ^-Al- e-^f^) 1 ,* _, (1.128) 

The table of Fourier transform properties (Table 1.2: Fourier Transform Properties) suggests 
thinking about this expression as a product of terms. 

• Multiplication by ^77 means integration. 



9 This content is available online at <http://cnx.Org/content/m0048/2.18/>. 
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• Multiplication by the complex exponential e~ i -' t27r ^> means delay by A seconds in the time 
domain. 

• The term 1 — e~( l27r ^ A ) means, in the time domain, subtract the time-delayed signal from its 
original. 

• The inverse transform of the frequency response is ^e _ Rcu(i). 

We can translate each of these frequency-domain products into time-domain operations in any 
order we like because the order in which multiplications occur doesn't affect the result. Let's 
start with the product of ^j (integration in the time domain) and the transfer function: 

e~T^)u{t) (1.129) 



i2nf 1 + i2irfRC 



The middle term in the expression for Y (/) consists of the difference of two terms: the constant 
1 and the complex exponential e~( l27T f A \ Because of the Fourier transform's linearity, we simply 
subtract the results. 

Y (/) w f 1 ~ e~^) u (t) - (l - e"^#) u (t - A) (1.130) 

Note that in delaying the signal how we carefully included the unit step. The second term in this 
result does not begin until t = A. Thus, the waveforms shown in the Filtering Periodic Signals 
(Figure 1.49: Filtering a periodic signal) example mentioned above are exponentials. We say that 
the time constant of an exponentially decaying signal equals the time it takes to decrease by - 
of its original value. Thus, the time-constant of the rising and falling portions of the output equal 
the product of the circuit's resistance and capacitance. 

Exercise 1.4.9.1 (Solution on p. 141.) 

Derive the filter's output by considering the terms in (1.127) in the order given. Integrate last 
rather than first. You should get the same answer. 

In this example, we used the table extensively to find the inverse Fourier transform, relying mostly on 
what multiplication by certain factors, like ^7 an d e~^ 2v ^ A \ meant. We essentially treated multiplication 
by these factors as if they were transfer functions of some fictitious circuit. The transfer function -t^j 

corresponded to a circuit that integrated, and e~^ l2v ^ A ' to one that delayed. We even implicitly interpreted 
the circuit's transfer function as the input's spectrum! This approach to finding inverse transforms - breaking 
down a complicated expression into products and sums of simple components - is the engineer's way of 
breaking down the problem into several subproblems that are much easier to solve and then gluing the results 
together. Along the way we may make the system serve as the input, but in the rule Y (/) = X (/) H (/), 
which term is the input and which is the transfer function is merely a notational matter (we labeled one 
factor with an X and the other with an H). 

1.4.9.1 Transfer Functions 

The notion of a transfer function applies well beyond linear circuits. Although we don't have all we need 
to demonstrate the result as yet, all linear, time-invariant systems have a frequency-domain input-output 
relation given by the product of the input's Fourier transform and the system's transfer function. Thus, 
linear circuits are a special case of linear, time-invariant systems. As we tackle more sophisticated problems 
in transmitting, manipulating, and receiving information, we will assume linear systems having certain 
properties (transfer functions) without worrying about what circuit has the desired property. At this point, 
you may be concerned that this approach is glib, and rightly so. Later we'll show that by involving software 
that we really don't need to be concerned about constructing a transfer function from circuit elements and 
op-amps. 
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1.4.9.2 Commutative Transfer Functions 

Another interesting notion arises from the commutative property of multiplication (exploited in an example 
above (Example 1.16)): We can rather arbitrarily chose an order in which to apply each product. Consider 
a cascade of two linear, time-invariant systems. Because the Fourier transform of the first system's output is 
X (/) Hi (/) and it serves as the second system's input, the cascade's output spectrum is X (/) Hi (/) H2 (/). 
Because this product also equals X (/) H2 (/) Hi (/), the cascade having the linear systems in the 
opposite order yields the same result. Furthermore, the cascade acts like a single linear system, having 
transfer function Hi (/) H 2 (/). This result applies to other configurations of linear, time-invariant systems 
as well; see this Frequency Domain Problem (Problem 1.13). Engineers exploit this property by determining 
what transfer function they want, then breaking it down into components arranged according to standard 
configurations. Using the fact that op-amp circuits can be connected in cascade with the transfer function 
equaling the product of its component's transfer function (see this analog signal processing problem 40 ), we 
find a ready way of realizing designs. We now understand why op-amp implementations of transfer functions 
are so important. 

1.4.10 Frequency Domain Problems 41 

Problem 1.1: Simple Fourier Series 

Find the complex Fourier series representations of the following signals without explicitly calculating Fourier 
integrals. What is the signal's period in each case? 



a) s (t) = sin (£) 

b) s (t) = sin 2 (t) 

c) s (t) = cos (t) + 2cos (2t) 

d) s (t) = cos (2t) cos (t) 

e) s(t) = cos(l07rf+ f) (1- 



- cos (2nt)) 



f) s (t) given by the depicted waveform (Figure 1.52). 



s(t) 



-►t 



113 
8 4 8 



Figure 1.52 



Problem 1.2: Fourier Series 

Find the Fourier series representation for the following periodic signals (Figure 1.53). For the third signal, 
find the complex Fourier series for the triangle wave without performing the usual Fourier integrals. Hint: 
How is this signal related to one for which you already have the series? 

40 "Analog Signal Processing Problems", Problem 44 <http://cnx.Org/content/ml0349/latest/#i25> 
41 This content is available online at <http://cnx.Org/content/ml0350/2.42/>. 
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fS(t) 




Problem 1.3: Phase Distortion 

We can learn about phase distortion by returning to circuits and investigate the following circuit (Fig- 
ure 1.54). 
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Figure 1.54 



a) Find this filter's transfer function. 

b) Find the magnitude and phase of this transfer function. How would you characterize this circuit? 

c) Let V[ n (t) be a square-wave of period T. What is the Fourier series for the output voltage? 

d) Use Matlab to find the output's waveform for the cases T = 0.01 and T = 2. What value of T delineates 
the two kinds of results you found? The software in fourier2.m might be useful. 

e) Instead of the depicted circuit, the square wave is passed through a system that delays its input, which 
applies a linear phase shift to the signal's spectrum. Let the delay t be j. Use the transfer function 
of a delay to compute using Matlab the Fourier series of the output. Show that the square wave is 
indeed delayed. 



Problem 1.4: Approximating Periodic Signals 

Often, we want to approximate a reference signal by a somewhat simpler signal. To assess the quality of 
an approximation, the most frequently used error measure is the mean-squared error. For a periodic signal 

i r T 

{s{t)-s{t)fdt 



where s (t) is the reference signal and s (t) its approximation. One convenient way of finding approximations 
for periodic signals is to truncate their Fourier series. 



A' 



*(*) = E 



c k e 



k=-K 

The point of this problem is to analyze whether this approach is the best (i.e., always minimizes the mean- 
squared error). 

a) Find a frequency-domain expression for the approximation error when we use the truncated Fourier 
series as the approximation. 

b) Instead of truncating the series, let's generalize the nature of the approximation to including any set of 
IK + 1 terms: We'll always include the Co and the negative indexed term corresponding to Cfc. What 
selection of terms minimizes the mean-squared error? Find an expression for the mean-squared error 
resulting from your choice. 

c) Find the Fourier series for the depicted signal (Figure 1.55). Use Matlab to find the truncated approx- 
imation and best approximation involving two terms. Plot the mean-squared error as a function of K 
for both approximations. 
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Figure 1.55 



Problem 1.5: Long, Hot Days 

The daily temperature is a consequence of several effects, one of them being the sun's heating. If this were 
the dominant effect, then daily temperatures would be proportional to the number of daylight hours. The 
plot (Figure 1.56) shows that the average daily high temperature does not behave that way. 




Figure 1.56 



In this problem, we want to understand the temperature component of our environment using Fourier 
series and linear system theory. The file temperature. mat contains these data (daylight hours in the first 
row, corresponding average daily highs in the second) for Houston, Texas. 

a) Let the length of day serve as the sole input to a system having an output equal to the average daily 
temperature. Examining the plots of input and output, would you say that the system is linear or not? 
How did you reach you conclusion? 



69 

b) Find the first five terms (co, ... , C4) of the complex Fourier series for each signal. 

c) What is the harmonic distortion in the two signals? Exclude c$ from this calculation. 

d) Because the harmonic distortion is small, let's concentrate only on the first harmonic. What is the 
phase shift between input and output signals? 

e) Find the transfer function of the simplest possible linear model that would describe the data. Char- 
acterize and interpret the structure of this model. In particular, give a physical explanation for the 
phase shift. 

f) Predict what the output would be if the model had no phase shift. Would days be hotter? If so, by 
how much? 



Problem 1.6: Fourier Transform Pairs 

Find the Fourier or inverse Fourier transform of the following. 

a) Vt: (ir(i) = e-( Q l*l)) 

b) x{t) = te~^u(t) 

1 if l/l < W 
if l/l > W 



X(f) 



d) x{t) 



W (2wf t) u (t) 



Problem 1.7: Duality in Fourier Transforms 

"Duality" means that the Fourier transform and the inverse Fourier transform are very similar. Conse- 
quently, the waveform s (t) in the time domain and the spectrum s (/) have a Fourier transform and an 
inverse Fourier transform, respectively, that are very similar. 

a) Calculate the Fourier transform of the signal shown below (Figure 1.57(a)). 

b) Calculate the inverse Fourier transform of the spectrum shown below (Figure 1.57(b)). 

c) How are these answers related? What is the general relationship between the Fourier transform of s (i) 
and the inverse transform of s (/)? 





(a) (b) 

Figure 1.57 



Problem 1.8: Spectra of Pulse Sequences 

Pulse sequences occur often in digital communication and in other fields as well. What are their spectral 
properties? 

a) Calculate the Fourier transform of the single pulse shown below (Figure 1.58(a)). 



70 



CHAPTER 1. SIGNALS AND SYSTEMS IN COMMUNICATIONS 



b) Calculate the Fourier transform of the two-pulse sequence shown below (Figure 1.58(b)). 

c) Calculate the Fourier transform for the ten-pulse sequence shown in below (Figure 1.58(c)). You 
should look for a general expression that holds for sequences of any length. 

d) Using Matlab, plot the magnitudes of the three spectra. Describe how the spectra change as the 
number of repeated pulses increases. 
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(c) 
Figure 1.58 



Problem 1.9: Spectra of Digital Communication Signals 

One way to represent bits with signals is shown in Figure 1.59. If the value of a bit is a "1", it is represented 
by a positive pulse of duration T. If it is a "0", it is represented by a negative pulse of the same duration. 
To represent a sequence of bits, the appropriately chosen pulses are placed one after the other. 



A"1" 



-►t 



"0" 



-►t 



Figure 1.59 



a) What is the spectrum of the waveform that represents the alternating bit sequence "...01010101.. 
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b) This signal's bandwidth is defined to be the frequency range over which 90% of the power is contained. 
What is this signal's bandwidth? 

c) Suppose the bit sequence becomes "...00110011...". Now what is the bandwidth? 



Problem 1.10: Lowpass Filtering a Square Wave 

Let a square wave (period T) serve as the input to a first-order lowpass system constructed as a RC filter. 
We want to derive an expression for the time-domain response of the filter to this input. 

a) First, consider the response of the filter to a simple pulse, having unit amplitude and width -^. Derive 
an expression for the filter's output to this pulse. 

b) Noting that the square wave is a superposition of a sequence of these pulses, what is the filter's response 
to the square wave? 

c) The nature of this response should change as the relation between the square wave's period and the 
filter's cutoff frequency change. How long must the period be so that the response does not achieve 
a relatively constant value between transitions in the square wave? What is the relation of the filter's 
cutoff frequency to the square wave's spectrum in this case? 



Problem 1.11: Mathematics with Circuits 

Simple circuits can implement simple mathematical operations, such as integration and differentiation. We 
want to develop an active circuit (it contains an op-amp) having an output that is proportional to the 
integral of its input. For example, you could use an integrator in a car to determine distance traveled from 
the speedometer. 

a) What is the transfer function of an integrator? 

b) Find an op-amp circuit so that its voltage output is proportional to the integral of its input for all 
signals. 

Problem 1.12: Where is that sound coming from? 

We determine where sound is coming from because we have two ears and a brain. Sound travels at a 
relatively slow speed and our brain uses the fact that sound will arrive at one ear before the other. As shown 
here (Figure 1.60), a sound coming from the right arrives at the left ear r seconds after it arrives at the right 
ear. 
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Figure 1.60 



Once the brain finds this propagation delay, it can determine the sound direction. In an attempt to 
model what the brain might do, RU signal processors want to design an optimal system that delays each 
ear's signal by some amount then adds them together. A; and A r are the delays applied to the left and right 
signals respectively. The idea is to determine the delay values according to some criterion that is based on 
what is measured by the two ears. 

a) What is the transfer function between the sound signal s (t) and the processor output y (£)? 

b) One way of determining the delay r is to choose Aj and A r to maximize the power in y (t). How are 
these maximum-power processing delays related to r? 



Problem 1.13: Arrangements of Systems 

Architecting a system of modular components means arranging them in various configurations to achieve 
some overall input-output relation. For each of the following (Figure 1.61), determine the overall transfer 
function between x (t) and y (t). 
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(a) system a 



x(t). 
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(b) system b 










H 2 (f) 





(c) system c 
Figure 1.61 



The overall transfer function for the cascade (first depicted system) is particularly interesting. What 
does it say about the effect of the ordering of linear, time-invariant systems in a cascade? 



Problem 1.14: Filtering 
Let the signal s (t) 



sin(7r£) 



be the input to a linear, time-invariant filter having the transfer function shown 



below (Figure 1.62). Find the expression for y(t), the filter's output. 



H(f). 



-►f 



Figure 1.62 
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Problem 1.15: Circuits Filter! 

A unit-amplitude pulse with duration of one second serves as the input to an RC-circuit having transfer 
function 

a) How would you categorize this transfer function: lowpass, highpass, bandpass, other? 

b) Find a circuit that corresponds to this transfer function. 

c) Find an expression for the filter's output. 

Problem 1.16: Reverberation 

Reverberation corresponds to adding to a signal its delayed version. 

a) Assuming r represents the delay, what is the input-output relation for a reverberation system? Is 
the system linear and time-invariant? If so, find the transfer function; if not, what linearity or time- 
invariance criterion does reverberation violate. 

b) A music group known as the ROwls is having trouble selling its recordings. The record company's 
engineer gets the idea of applying different delay to the low and high frequencies and adding the result 
to create a new musical effect. Thus, the ROwls' audio would be separated into two parts (one less 
than the frequency /o, the other greater than /o), these would be delayed by 77 and Th respectively, 
and the resulting signals added. Draw a block diagram for this new audio processing system, showing 
its various components. 

c) How does the magnitude of the system's transfer function depend on the two delays? 

Problem 1.17: Echoes in Telephone Systems 

A frequently encountered problem in telephones is echo. Here, because of acoustic coupling between the ear 
piece and microphone in the handset, what you hear is also sent to the person talking. That person thus 
not only hears you, but also hears her own speech delayed (because of propagation delay over the telephone 
network) and attenuated (the acoustic coupling gain is less than one). Furthermore, the same problem 
applies to you as well: The acoustic coupling occurs in her handset as well as yours. 

a) Develop a block diagram that describes this situation. 

b) Find the transfer function between your voice and what the listener hears. 

c) Each telephone contains a system for reducing echoes using electrical means. What simple system 
could null the echoes? 



Problem 1.18: Effective Drug Delivery 

In most patients, it takes time for the concentration of an administered drug to achieve a constant level 
in the blood stream. Typically, if the drug concentration in the patient's intravenous line is Cdu(t), the 
concentration in the patient's blood stream is C p (l — e^ *') u (t). 

a) Assuming the relationship between drug concentration in the patient's drug and the delivered concen- 
tration can be described as a linear, time-invariant system, what is the transfer function? 

b) Sometimes, the drug delivery system goes awry and delivers drugs with little control. What would the 
patient's drug concentration be if the delivered concentration were a ramp? More precisely, if it were 
C d tu(t)? 

c) A clever doctor wants to have the flexibility to slow down or speed up the patient's drug concentration. 
In other words, the concentration is to be C p (l — e _( - b *- ) ) u (£), with b bigger or smaller than a. How 
should the delivered drug concentration signal be changed to achieve this concentration profile? 
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Problem 1.19: Catching Speeders with Radar 

RU Electronics has been contracted to design a Doppler radar system. Radar transmitters emit a signal that 
bounces off any conducting object. Signal differences between what is sent and the radar return is processed 
and features of interest extracted. In Doppler systems, the object's speed along the direction of the radar 
beam is the feature the design must extract. The transmitted signal is a sinsusoid: x (t) = Acos (2nf c t). 
The measured return signal equals Bcos (2w ((/ c + Af) t + ip)), where the Doppler offset frequency Af equals 
10i>, where v is the car's velocity coming toward the transmitter. 

a) Design a system that uses the transmitted and return signals as inputs and produces Af. 

b) One problem with designs based on overly simplistic design goals is that they are sensitive to unmodeled 
assumptions. How would you change your design, if at all, so that whether the car is going away or 
toward the transmitter could be determined? 

c) Suppose two objects traveling different speeds provide returns. How would you change your design, if 
at all, to accomodate multiple returns? 



Problem 1.20: Demodulating an AM Signal 

Let m (t) denote the signal that has been amplitude modulated. 

x (t) = A (1 + m 0)) sin (27r/ c i) 

Radio stations try to restrict the amplitude of the signal to (t) so that it is less than one in magnitude. The 
frequency f c is very large compared to the frequency content of the signal. What we are concerned about 
here is not transmission, but reception. 

a) The so-called coherent demodulator simply multiplies the signal x (t) by a sinusoid having the same 
frequency as the carrier and lowpass filters the result. Analyze this receiver and show that it works. 
Assume the lowpass filter is ideal. 

b) One issue in coherent reception is the phase of the sinusoid used by the receiver relative to that used 
by the transmitter. Assuming that the sinusoid of the receiver has a phase cf>, how does the output 
depend on cf>? What is the worst possible value for this phase? 

c) The incoherent receiver is more commonly used because of the phase sensitivity problem inherent in 
coherent reception. Here, the receiver full-wave rectifies the received signal and lowpass filters the 
result (again ideally) . Analyze this receiver. Does its output differ from that of the coherent receiver 
in a significant way? 

Problem 1.21: Unusual Amplitude Modulation 

We want to send a band-limited signal having the depicted spectrum (Figure 1.63(a)) with amplitude mod- 
ulation in the usual way. I.B. Different suggests using the square-wave carrier shown below (Figure 1.63(b)). 
Well, it is different, but his friends wonder if any technique can demodulate it. 

a) Find an expression for X (/), the Fourier transform of the modulated signal. 

b) Sketch the magnitude of X (/), being careful to label important magnitudes and frequencies. 

c) What demodulation technique obviously works? 

d) I.B. challenges three of his friends to demodulate x (t) some other way. One friend suggests modulating 
x (t) with cos (-y), another wants to try modulating with cos (irt) and the third thinks cos (^p) will 
work. Sketch the magnitude of the Fourier transform of the signal each student's approach produces. 
Which student comes closest to recovering the original signal? Why? 
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Figure 1.63 



Problem 1.22: Sammy Falls Asleep... 

While sitting in ELEC 241 class, he falls asleep during a critical time when an AM receiver is being described. 
The received signal has the form r (i) = A (1 + m (£)) cos (27r/ c £ + </>) where the phase <p is unknown. The 
message signal is m (t); it has a bandwidth of W Hz and a magnitude less than 1 (\m (t) \ < 1). The phase 4> 
is unknown. The instructor drew a diagram (Figure 1.64) for a receiver on the board; Sammy slept through 
the description of what the unknown systems where. 
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Figure 1.64 



a) What are the signals x c (t) and x s (£)? 

b) What would you put in for the unknown systems that would guarantee that the final output contained 
the message regardless of the phase? 

Hint: Think of a trigonometric identity that would prove useful. 

c) Sammy may have been asleep, but he can think of a far simpler receiver. What is it? 
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Problem 1.23: Jamming 

Sid Richardson college decides to set up its own AM radio station KSRR. The resident electrical engineer 
decides that she can choose any carrier frequency and message bandwidth for the station. A rival college 
decides to jam its transmissions by transmitting a high-power signal that interferes with radios that try to 
receive KSRR. The jamming signal jam (t) is what is known as a sawtooth wave (depicted in Figure 1.65) 
having a period known to KSRR's engineer. 



Ajam(t) 
A 




Figure 1.65 



a) Find the spectrum of the jamming signal. 

b) Can KSRR entirely circumvent the attempt to jam it by carefully choosing its carrier frequency and 
transmission bandwidth? If so, find the station's carrier frequency and transmission bandwidth in 
terms of T, the period of the jamming signal; if not, show why not. 



Problem 1.24: AM Stereo 

A stereophonic signal consists of a "left" signal I (£) and a "right" signal r (t) that conveys sounds coming 
from an orchestra's left and right sides, respectively. To transmit these two signals simultaneously, the 
transmitter first forms the sum signal s+ (t) = I (t) + r (t) and the difference signal s_ (t) = I (t) — r (t). 
Then, the transmitter amplitude-modulates the difference signal with a sinusoid having frequency 2W, where 
W is the bandwidth of the left and right signals. The sum signal and the modulated difference signal are 
added, the sum amplitude-modulated to the radio station's carrier frequency f c , and transmitted. Assume 
the spectra of the left and right signals are as shown (Figure 1.66). 




AR(f) 



► f 



-w 



w 



-►f 



Figure 1.66 



a) What is the expression for the transmitted signal? Sketch its spectrum. 
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b) Show the block diagram of a stereo AM receiver that can yield the left and right signals as separate 
outputs. 

c) What signal would be produced by a conventional coherent AM receiver that expects to receive a 
standard AM signal conveying a message signal having bandwidth W? 



Problem 1.25: Novel AM Stereo Method 

A clever engineer has submitted a patent for a new method for transmitting two signals simultaneously 
in the same transmission bandwidth as commercial AM radio. As shown (Figure 1.67), her approach is to 
modulate the positive portion of the carrier with one signal and the negative portion with a second. 



Example Transmitter Waveform 




Figure 1.67 



In detail the two message signals mi (£) and rri2 (t) are bandlimited to W Hz and have maximal amplitudes 
equal to 1. The carrier has a frequency f c much greater than W. The transmitted signal x (t) is given by 



xit) 



A(l + arm (t)) sin (2?r/ c t) if sin (2nf c t) > 
A{1 + am 2 (*)) sin (2?r/ c i) if sin (2irf c t) < 



In all cases, < a < 1. The plot shows the transmitted signal when the messages are sinusoids: mi (t) = 
sin (2irf m t) and 7712 (t) = sin (2it2f m t) where 2f m < W. You, as the patent examiner, must determine 
whether the scheme meets its claims and is useful. 

a) Provide a more concise expression for the transmitted signal x (t) than given above. 

b) What is the receiver for this scheme? It would yield both m\ (t) and 7712 (t) from x (t). 

c) Find the spectrum of the positive portion of the transmitted signal. 

d) Determine whether this scheme satisfies the design criteria, allowing you to grant the patent. Explain 
your reasoning. 
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Problem 1.26: A Radical Radio Idea 

An ELEC 241 student has the bright idea of using a square wave instead of a sinusoid as an AM carrier. 
The transmitted signal would have the form 

x(i) = A{l + m(t))sq T (t) 

where the message signal m (t) would be amplitude-limited: \m (£) | < 1 

a) Assuming the message signal is lowpass and has a bandwidth of W Hz, what values for the square 
wave's period T are feasible. In other words, do some combinations of W and T prevent reception? 

b) Assuming reception is possible, can standard radios receive this innovative AM transmission? If so, 
show how a coherent receiver could demodulate it; if not, show how the coherent receiver's output 
would be corrupted. Assume that the message bandwidth W = 5 kHz. 

Problem 1.27: Secret Communication 

An amplitude-modulated secret message m (t) has the following form. 

r (t) = A (1 + m (*)) cos (2tt (f c + f ) t) 

The message signal has a bandwidth of W Hz and a magnitude less than 1 (\m(t) \ < 1). The idea is to 
offset the carrier frequency by / Hz from standard radio carrier frequencies. Thus, "off-the-shelf" coherent 
demodulators would assume the carrier frequency has f c Hz. Here, /o < W. 

a) Sketch the spectrum of the demodulated signal produced by a coherent demodulator tuned to f c Hz. 

b) Will this demodulated signal be a "scrambled" version of the original? If so, how so; if not, why not? 

c) Can you develop a receiver that can demodulate the message without knowing the offset frequency / c ? 

Problem 1.28: Signal Scrambling 

An excited inventor announces the discovery of a way of using analog technology to render music unlistenable 
without knowing the secret recovery method. The idea is to modulate the bandlimited message m (t) by a 
special periodic signal s (t) that is zero during half of its period, which renders the message unlistenable and 
superficially, at least, unrecoverable (Figure 1.68). 




Figure 1.68 



a) What is the Fourier series for the periodic signal? 

b) What are the restrictions on the period T so that the message signal can be recovered from m (t) s (£)? 

c) ELEC 241 students think they have "broken" the inventor's scheme and are going to announce it to 
the world. How would they recover the original message without having detailed knowledge of the 
modulating signal? 
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1.5 Continuous Time Fourier Transform (CTFT) 
1.5.1 Continuous Time Fourier Transform (CTFT) 42 

1.5.1.1 Introduction 

In this module, we will derive an expansion for any arbitrary continuous-time function, and in doing so, 
derive the Continuous Time Fourier Transform (CTFT). 

Since complex exponentials (Section 1.1.5) are eigenfunctions of linear time-invariant (LTI) systems 43 , 
calculating the output of an LTI system H given e st as an input amounts to simple multiplication, where 
H (s) G C is the eigenvalue corresponding to s. As shown in the figure, a simple exponential input would 
yield the output 

y(t) = H(s)e st (1.131) 



Image notjinished 



Using this and the fact that H is linear, calculating y (t) for combinations of complex exponentials is also 
straightforward. 

cie Sl * + c 2 e S2t -> ciH (si) e Sl * + c 2 H (s 2 ) e S2 * 



£< 






C n H (s r , 



The action of H on an input such as those in the two equations above is easy to explain. H inde- 
pendently scales each exponential component e s ™* by a different complex number H (s n ) € C. As such, if 
we can write a function / (t) as a combination of complex exponentials it allows us to easily calculate the 
output of a system. 

Now, we will look to use the power of complex exponentials to see how we may represent arbitrary signals 
in terms of a set of simpler functions by superposition of a number of complex exponentials. Below we will 
present the Continuous-Time Fourier Transform (CTFT), commonly referred to as just the Fourier 
Transform (FT). Because the CTFT deals with nonperiodic signals, we must find a way to include all real 
frequencies in the general equations. For the CTFT we simply utilize integration over real numbers rather 
than summation over integers in order to express the aperiodic signals. 

1.5.1.2 Fourier Transform Synthesis 

Joseph Fourier 44 demonstrated that an arbitrary s (t) can be written as a linear combination of harmonic 
complex sinusoids 

oo 

s(t)= J^ c n e jUont (1.132) 

n — — oo 

where to = ^ is the fundamental frequency. For almost all s (t) of practical interest, there exists c„ to make 
(1.132) true. If s (t) is finite energy ( s (t) € L 2 [0, T]), then the equality in (1.132) holds in the sense of energy 
convergence; if s (t) is continuous, then (1.132) holds pointwise. Also, if s (t) meets some mild conditions 
(the Dirichlet conditions), then (1.132) holds pointwise everywhere except at points of discontinuity. 

The c n - called the Fourier coefficients - tell us "how much" of the sinusoid e- 7 " ™* is in s (t). The formula 
shows s (t) as a sum of complex exponentials, each of which is easily processed by an LTI system (since it 
is an eigenfunction of every LTI system). Mathematically, it tells us that the set of complex exponentials 
{Vn, neZ: ( e M>™t) j form a basis for the space of T-periodic continuous time functions. 



42 This content is available online at <http://cnx.Org/content/ml0098/2.16/>. 
43 "Eigenfunctions of LTI Systems" <http://cnx.org/content/ml0500/latest/> 
44 http:// www-groups. dcs.st-and.ac.uk/~history/Mathematicians/Fourier. html 
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1.5.1.2.1 Equations 

Now, in order to take this useful tool and apply it to arbitrary non-periodic signals, we will have to delve 
deeper into the use of the superposition principle. Let st (t) be a periodic signal having period T. We want 
to consider what happens to this signal's spectrum as the period goes to infinity. We denote the spectrum 
for any assumed value of the period by c n (T). We calculate the spectrum according to the Fourier formula 
for a periodic signal, known as the Fourier Series (for more on this derivation, see the section on Fourier 
Series.) 

1 '- T 



, s (t) exp (-Quj a t) dt (1.133) 

where ujq = ^ and where we have used a symmetric placement of the integration interval about the origin 
for subsequent derivational convenience. We vary the frequency index n proportionally as we increase the 
period. Define 

S T (f) = Tc n =l= f (S T (/) exp (6w t) d*(1.134) 
1 Jo 

making the corresponding Fourier Series 

st (t) = JT/ (t) exp (Bw t) ^ (1-135) 

— oo 

As the period increases, the spectral lines become closer together, becoming a continuum. Therefore, 



lim s T (t) = s (t) = S{f)exp{Quj t)df (1.136) 

T — >oo 

with 

S(f)= I s(-/)r.r/,(-IW) <H (1.137) 

Continuous-Time Fourier Transform 

JF(0)= / f{t)e' (iat) dt (1.138) 

Inverse CTFT 

f(t)=—l F(fL)e mt dn (1.139) 

warning: It is not uncommon to see the above formula written slightly different. One of the most 
common differences is the way that the exponential is written. The above equations use the radial 
frequency variable Vt in the exponential, where Q. = 2irf, but it is also common to include the more 
explicit expression, i2wft, in the exponential. Click here 45 for an overview of the notation used in 
Connexion's DSP modules. 



Example 1.17 

Fn-nloT-'a fnrmnlQ +no+ fr\ c i/.i+l _l_ on \t.\4-\ — l f 



We know from Euler's formula that cos (u>t) + sin (cot) = K^e^ 1 + -^e • ?tJt . 



"DSP notation" <http://cnx.org/content/ml0161/latest/> 
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1.5.1.3 CTFT Definition Demonstration 







CTFT Definition 
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Figure 1.69: Interact (when online) with a Mathematica CDF demonstrating Continuous Time Fourier 
Transform. To Download, right-click and save as .cdf. 



1.5.1.4 Example Problems 

Exercise 1.5.1.1 

Find the Fourier Transform (CTFT) of the function 



(Solution on p. 141.) 



fit) 



e -(«t) if t > 
otherwise 



(1.140) 



Exercise 1.5.1.2 (Solution on p. 141.) 

Find the inverse Fourier transform of the ideal lowpass filter defined by 

, i if \n\ < M / 

X(fL)= { ' ' " (1.141) 

otherwise 



1.5.1.5 Fourier Transform Summary 

Because complex exponentials are eigenfunctions of LTI systems, it is often useful to represent signals using 
a set of complex exponentials as a basis. The continuous time Fourier series synthesis formula expresses a 
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continuous time, periodic function as the sum of continuous time, discrete frequency complex exponentials. 

DC 



n— — oo 



The continuous time Fourier series analysis formula gives the coefficients of the Fourier series expansion. 



n =)= f f{t)e-^ nt Ut (1.143) 



1 Jo 
In both of these equations u>o = %jr is the fundamental frequency. 

1.5.2 Properties of the CTFT 46 

1.5.2.1 Introduction 

This module will look at some of the basic properties of the Continuous-Time Fourier Transform (Sec- 
tion 1.5.1) (CTFT). 

note: We will be discussing these properties for aperiodic, continuous-time signals but understand 
that very similar properties hold for discrete-time signals and periodic signals as well. 

1.5.2.2 Discussion of Fourier Transform Properties 

1.5.2.2.1 Linearity 

The combined addition and scalar multiplication properties in the table above demonstrate the basic property 
of linearity. What you should see is that if one takes the Fourier transform of a linear combination of signals 
then it will be the same as the linear combination of the Fourier transforms of each of the individual signals. 
This is crucial when using a table (Section 1.8.7) of transforms to find the transform of a more complicated 
signal. 

Example 1.18 

We will begin with the following signal: 

z(t) = af 1 (t) + bf 2 (t) (1.144) 

Now, after we take the Fourier transform, shown in the equation below, notice that the linear 
combination of the terms is unaffected by the transform. 

Z (u>) = aF x (u>) + bF 2 (w) (1.145) 



1.5.2.2.2 Symmetry 

Symmetry is a property that can make life quite easy when solving problems involving Fourier transforms. 
Basically what this property says is that since a rectangular function in time is a sine function in frequency, 
then a sine function in time will be a rectangular function in frequency. This is a direct result of the similarity 
between the forward CTFT and the inverse CTFT. The only difference is the scaling by 2n and a frequency 
reversal. 



6 This content is available online at <http://cnx.Org/content/ml0100/2.15/>. 
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1.5.2.2.3 Time Scaling 

This property deals with the effect on the frequency-domain representation of a signal if the time variable 
is altered. The most important concept to understand for the time scaling property is that signals that are 
narrow in time will be broad in frequency and vice versa. The simplest example of this is a delta function, 
a unit pulse 47 with a very small duration, in time that becomes an infinite-length constant function in 
frequency. 

The table above shows this idea for the general transformation from the time-domain to the frequency- 
domain of a signal. You should be able to easily notice that these equations show the relationship mentioned 
previously: if the time variable is increased then the frequency range will be decreased. 

1.5.2.2.4 Time Shifting 

Time shifting shows that a shift in time is equivalent to a linear phase shift in frequency. Since the frequency 
content depends only on the shape of a signal, which is unchanged in a time shift, then only the phase 
spectrum will be altered. This property is proven below: 

Example 1.19 

We will begin by letting z(t) = f (t — t). Now let us take the Fourier transform with the previous 
expression substituted in for z (t). 

f'OO 

Z{uj)= f(t-T)e- {iujt) dt (1.146) 



Now let us make a simple change of variables, where a = t — r. Through the calculations below, 
you can see that only the variable in the exponential are altered thus only changing the phase in 
the frequency domain. 

Z(uj) = /^ / (cr) e-^^+^'W 

= e~^ T ) /^/(o-je-^W (1.147) 



1.5.2.2.5 Convolution 

Convolution is one of the big reasons for converting signals to the frequency domain, since convolution in 
time becomes multiplication in frequency. This property is also another excellent example of symmetry 
between time and frequency. It also shows that there may be little to gain by changing to the frequency 
domain when multiplication in time is involved. 

We will introduce the convolution integral here, but if you have not seen this before or need to refresh 
your memory, then look at the continuous-time convolution (Section 1.3.1) module for a more in depth 
explanation and derivation. 

y(t) = (A (*) , / 2 (*)) 

= /~ /i(r)/ 2 (*-r)dr 



"Elemental Signals": Section Pulse <http://cnx.Org/content/m0004/latest/#pulsedef> 
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1.5.2.2.6 Time Differentiation 

Since LTI (Section 1.2.1) systems can be represented in terms of differential equations, it is apparent with 
this property that converting to the frequency domain may allow us to convert these complicated differential 
equations to simpler equations involving multiplication and addition. This is often looked at in more detail 
during the study of the Laplace Transform 48 . 



1.5.2.2.7 Parseval's Relation 



f 

J — < 



/•OO 

(\f(t)\fdt= {\F{w)\fdf (1.149) 



Parseval's relation tells us that the energy of a signal is equal to the energy of its Fourier transform. 



fit) < ► F{m) 



Figure 1.70 



1.5.2.2.8 Modulation (Frequency Shift) 

Modulation is absolutely imperative to communications applications. Being able to shift a signal to a different 
frequency, allows us to take advantage of different parts of the electromagnetic spectrum is what allows us 
to transmit television, radio and other applications through the same space without significant interference. 
The proof of the frequency shift property is very similar to that of the time shift (Section 1.5.2.2.4: Time 
Shifting); however, here we would use the inverse Fourier transform in place of the Fourier transform. Since 
we went through the steps in the previous, time-shift proof, below we will just show the initial and final step 
to this proof: 

i r°° 

z (t) = — F(uj-4>)e iuJt duj (1.150) 

2tt 7„oo 

Now we would simply reduce this equation through another change of variables and simplify the terms. 
Then we will prove the property expressed in the table above: 

z(t) = f(t)e i * t (1.151) 



1.5.2.3 Properties Demonstration 

An interactive example demonstration of the properties is included below: 



"The Laplace Transform" <http://cnx.org/content/ml0110/latest/> 
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This media object is a Lab VIEW VI. Please view or download it at 
<CTFTSPlab.llb> 

Figure 1.71: Interactive Signal Processing Laboratory Virtual Instrument created using NI's Labview. 



1.5.2.4 Summary Table of CTFT Properties 



Operation Name 


Signal (/(*)) 


Transform ( F (w) ) 


Linearity (Section 1.5.2.2.1: Lin- 
earity) 


a(fi,t) + b(f 2 ,t) 


a{F u w) + b{F 2 ,w) 


Scalar Multiplication (Sec- 
tion 1.5.2.2.1: Linearity) 


af(t) 


uF{oj) 


Symmetry (Section 1.5.2.2.2: 
Symmetry) 


F(t) 


27T/(-«) 


Time Scaling (Section 1.5.2.2.3: 
Time Scaling) 


f(at) 


J-F(^-) 

\a\ r \a) 


Time Shift (Section 1.5.2.2.4: 
Time Shifting) 


f(t-r) 


F(u>)e- (iiJ ^ 


Convolution in Time (Sec- 
tion 1.5.2.2.5: Convolution) 


(/i (*) , /a (*)) 


Fi (t) F 2 (t) 


Convolution in Frequency (Sec- 
tion 1.5.2.2.5: Convolution) 


h{t)h{t) 


±( Fl (t),F 2 (t)) 


Differentiation (Section 1.5.2.2.6: 
Time Differentiation) 


&/(*) 


(iuj) n F(cj) 


Parseval's Theorem (Sec- 
tion 1.5.2.2.7: Parseval's Re- 
lation) 


Hod/Wl) 2 * 


JZdF^lfdf 


Modulation (Frequency Shift) 
(Section 1.5.2.2.8: Modulation 
(Frequency Shift)) 


/(t)e<** 


F{u-4>) 



Table 1.3: Table of Fourier Transform Properties 



1.6 Sampling theory 
1.6.1 Introduction 49 

Contents of Sampling chapter 

• Introduction (Current module) 

• Proof (Section 1.6.2) 

49 This content is available online at <http://cnx.Org/content/mll419/l.29/>. 
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Illustrations (Section 1.6.3) 

Matlab Example 50 

Hold operation 51 

System view (Section 1.6.4) 

Aliasing applet 52 

Exercises 53 

Table of formulas 54 



1.6.1.1 Why sample? 

This section introduces sampling. Sampling is the necessary fundament for all digital signal processing and 
communication. Sampling can be defined as the process of measuring an analog signal at distinct points. 
Digital representation of analog signals offers advantages in terms of 

• robustness towards noise, meaning we can send more bits/s 

• use of flexible processing equipment, in particular the computer 

• more reliable processing equipment 

• easier to adapt complex algorithms 

1.6.1.2 Claude E. Shannon 




Figure 1.72: Claude Elwood Shannon (1916-2001) 



Claude Shannon 55 has been called the father of information theory, mainly due to his landmark papers on the 
"Mathematical theory of communication" 56 . Harry Nyquist 57 was the first to state the sampling theorem 



50 "Sampling and reconstruction with Matlab" <http://cnx.org/content/mll549/latest/> 
51 "Hold operation" <http://cnx.org/content/mll458/latest/> 
52 "Aliasing Applet" <http://cnx.org/content/mll448/latest/> 
53 "Exercises" <http://cnx.org/content/mll442/latest/> 

<http://cnx.org/content/mll450/latest/> 



54 "Table of Formulas" 



55 http 
56 http 
57 http 



// www.research.att.com/~njas/doc/ces5. html 

//cm. bell-labs.com/cm/ms/what/shannonday/ shannonl948.pdf 

//www. wikipedia.org/wiki/Harry Nyquist 
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in 1928, but it was not proven until Shannon proved it 21 years later in the paper "Communications in the 
presence of noise" 58 . 

1.6.1.3 Notation 

In this chapter we will be using the following notation 

• Original analog signal x (t) 

• Sampling frequency F s 

• Sampling interval T s (Note that: F s = -jr) 

• Sampled signal x s (n). (Note that x s (n) = x (nT s )) 

• Real angular frequency £1 

• Digital angular frequency to. (Note that: uj = OT s ) 

1.6.1.4 The Sampling Theorem 

note: When sampling an analog signal the sampling frequency must be greater than twice the 
highest frequency component of the analog signal to be able to reconstruct the original signal from 
the sampled version. 



1.6.1.5 

Finished? Have at look at: Proof (Section 1.6.2); Illustrations (Section 1.6.3); Matlab Example 59 ; Aliasing 
applet 60 ; Hold operation 61 ; System view (Section 1.6.4); Exercises 62 

1.6.2 Proof 3 

note: In order to recover the signal x (t) from it's samples exactly, it is necessary to sample x (t) 
at a rate greater than twice it's highest frequency component. 



1.6.2.1 Introduction 

As mentioned earlier (p. 87), sampling is the necessary fundament when we want to apply digital signal 
processing on analog signals. 

Here we present the proof of the sampling theorem. The proof is divided in two. First we find an 
expression for the spectrum of the signal resulting from sampling the original signal x(t). Next we show 
that the signal x (t) can be recovered from the samples. Often it is easier using the frequency domain when 
carrying out a proof, and this is also the case here. 

Key points in the proof 

• We find an equation (1.159) for the spectrum of the sampled signal 

• We find a simple method to reconstruct (1.165) the original signal 

• The sampled signal has a periodic spectrum... 

• ...and the period is 2 x irF s 

58 http:// www.stanford.edu/class/eel04/sh annonpaper.pdf 

59 "Sampling and reconstruction with Matlab" <http://cnx.org/content/mll549/latest/> 

60 "Aliasing Applet" <http://cnx.org/content/mll448/latest/> 

61 "Hold operation" <http://cnx.org/content/mll458/latest/> 

62 "Exercises" <http://cnx.org/content/mll442/latest/> 

63 This content is available online at <http://cnx.Org/content/mll423/l.27/>. 
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1.6.2.2 Proof part 1 - Spectral considerations 

By sampling x (t) every T s second we obtain x s (n). The inverse fourier transform of this time discrete 
signal 64 is 

x s (n) = — J X s (e ibJ ) e ibjn dui (1.152) 

For convenience we express the equation in terms of the real angular frequency 0, using lu = QT S . We then 
obtain 

x s (n) = ^ f Ts X s (e mT °) e mT ° n d n (1.153) 

The inverse fourier transform of a continuous signal is 

1 f°° 
x{t) = — X{in)e tm dn (1.154) 

2lT J-oo 

From this equation we find an expression for x (nT s ) 

1 



x(nT s ) = —l X{in)e innT °dn (1.155) 

21" J_oo 



To account for the difference in region of integration we split the integration in (1.155) into subintervals of 

OC - (2* + l)» 



length I? and then take the sum over the resulting integrals to obtain the complete area. 



( n T s )=— Y] f T ' X{in)e mnT °dfl (1.156) 



Then we change the integration variable, setting £1 = r\ 



k= — OO T. 

2xirk 



T s 



1 \-^ f T « „ ( ( 2 x irk 



*&?.) = ± E j^x{*{v + ^))e(^^d V (1.157) 

We obtain the final form by observing that e l2X7Tkn = i j reinserting rj = £1 and multiplying by ^ 



x(nT s )=^-j2 £ Y s X { l { n+2 -^)) emnTsdn (L158) 

To make x s (n) = x (nT s ) for all values of n, the integrands in (1.153) and (1.158) have to agreee, that is 

X.{e«f') = ±. £) x(i(n+ 2 -^)) (1.159) 



K— — OO 



This is a central result. We see that the digital spectrum consists of a sum of shifted versions of the original, 
analog spectrum. Observe the periodicity! 

We can also express this relation in terms of the digital angular frequency u> = £1T S 

Xs (e-) = 1 £ X (i^y^) (1.160) 

k— — oo 

This concludes the first part of the proof. Now we want to find a reconstruction formula, so that we can 
recover x (t) from x s (n). 



64 "Discrete time signals" <http://cnx.org/content/mll476/latest/> 
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1.6.2.3 Proof part II - Signal reconstruction 

For a bandlimited (Figure 1.74) signal the inverse fourier transform is 

1 f^ 



x(t) 



2tt 



x {in) e iut dn 



(1.161) 



In the interval we are integrating we have: X s (e lS1Ts ) = ^ '- . Substituting this relation into (1.161) we 
get 



x{t) 



T Ft 

± s I 

2^ 



X s (e inT °)e mt dn 



Using the DTFT 65 relation for X s (e mT ") we have 



x(t) 



2n 



J2 x s (n)e-( mnT ^e mt dn 



t s n— — oo 



Interchanging integration and summation (under the assumption of convergence) leads to 

a (*) = §: £ x s (n) f^ e in ^- nT ^dn 

n— — oo T s 

Finally we perform the integration and arrive at the important reconstruction formula 

sin I -Ijr (t — nT s 



■(*)= E x ^ r 



&{t- nT s 



(Thanks to R.Loos for pointing out an error in the proof.) 



(1.162) 



(1.163) 



(1.164) 



(1.165) 



"Table of Formulas" <http://cnx.org/content/mll450/latest/> 
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1.6.2.4 Summary 



note: X s (e«* r -) = ± ; Z? = - 00 x(i(a 



2nk 



. ^aa . . sin( ^-(t— nT s ) ) 

note: x(t) = Y,n=- 00 x 8 (n) VV_ n r.) 



1.6.2.5 



Go to Introduction (Section 1.6.1); Illustrations (Section 1.6.3); Matlab Example 66 ; Hold operation 67 ; Alias- 
ing applet 68 ; System view (Section 1.6.4); Exercises 69 ? 

1,6.3 Illustrations 70 

In this module we illustrate the processes involved in sampling and reconstruction. To see how all these 
processes work together as a whole, take a look at the system view (Section 1.6.4). In Sampling and 
reconstruction with Matlab 71 we provide a Matlab script for download. The matlab script shows the process 
of sampling and reconstruction live. 

1.6.3.1 Basic examples 

Example 1.20 

To sample an analog signal with 3000 Hz as the highest frequency component requires sampling 
at 6000 Hz or above. 

Example 1.21 

The sampling theorem can also be applied in two dimensions, i.e. for image analysis. A 2D 
sampling theorem has a simple physical interpretation in image analysis: Choose the sampling 
interval such that it is less than or equal to half of the smallest interesting detail in the image. 



1.6.3.2 The process of sampling 

We start off with an analog signal. This can for example be the sound coming from your stereo at home or 
your friend talking. 

The signal is then sampled uniformly. Uniform sampling implies that we sample every T s seconds. In 
Figure 1.73 we see an analog signal. The analog signal has been sampled at times t = nT s . 



66 "Sampling and reconstruction with Matlab" <http://cnx.org/content/mll549/latest/> 

67 "Hold operation" <http://cnx.org/content/mll458/latest/> 

68 "Aliasing Applet" <http://cnx.org/content/mll448/latest/> 

69 "Exercises" <http://cnx.org/content/mll442/latest/> 

70 This content is available online at <http://cnx.Org/content/mll443/l.33/>. 

71 "Sampling and reconstruction with Matlab" <http://cnx.org/content/mll549/latest/> 
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Figure 1.73: Analog signal, samples are marked with dots. 



In signal processing it is often more convenient and easier to work in the frequency domain. So let's look 
at at the signal in frequency domain, Figure 1.74. For illustration purposes we take the frequency content 
of the signal as a triangle. (If you Fourier transform the signal in Figure 1.73 you will not get such a nice 
triangle.) 




Figure 1.74: The spectrum X (ifl). 



Notice that the signal in Figure 1.74 is bandlimited. We can see that the signal is bandlimited because 
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X (iCl) is zero outside the interval [— Cl g ,Cl g ]. Equivalentely we can state that the signal has no angular 
frequencies above Q, g , corresponding to no frequencies above F g = -^-. 

Now let's take a look at the sampled signal in the frequency domain. While proving (Section 1.6.2) the 
sampling theorem we found the the spectrum of the sampled signal consists of a sum of shifted versions of 
the analog spectrum. Mathematically this is described by the following equation: 



X.(- 



iflT s 



1 

t: 



E* 



fe=-c 



Q 



2irk 
~T7 



(1.166) 



1.6.3.2.1 Sampling fast enough 

In Figure 1.75 we show the result of sampling x (t) according to the sampling theorem (Section 1.6.1.4: The 
Sampling Theorem). This means that when sampling the signal in Figure 1.73/Figure 1.74 we use F s > 2F g . 
Observe in Figure 1.75 that we have the same spectrum as in Figure 1.74 for fi s [— Q, g , Q, g ], except for the 
scaling factor ^-. This is a consequence of the sampling frequency. As mentioned in the proof (Key points 
in the proof, p. 88) the spectrum of the sampled signal is periodic with period 2nF s = ^-. 




figure 1.75: The spectrum X s . Sampling frequency is OK. 



So now we are, according to the sample theorem (Section 1.6.1.4: The Sampling Theorem), able to recon- 
struct the original signal exactly. How we can do this will be explored further down under reconstruction 
(Section 1.6.3.3: Reconstruction). But first we will take a look at what happens when we sample too slowly. 

1.6.3.2.2 Sampling too slowly 

If we sample x(t) too slowly, that is F s < 2F g , we will get overlap between the repeated spectra, see 
Figure 1.76. According to (1.166) the resulting spectra is the sum of these. This overlap gives rise to the 
concept of aliasing. 

note: If the sampling frequency is less than twice the highest frequency component, then frequen- 
cies in the original signal that are above half the sampling rate will be "aliased" and will appear in 
the resulting signal as lower frequencies. 

The consequence of aliasing is that we cannot recover the original signal, so aliasing has to be avoided. 
Sampling too slowly will produce a sequence x s (n) that could have orginated from a number of signals. 
So there is no chance of recovering the original signal. To learn more about aliasing, take a look at this 
module 72 . (Includes an applet for demonstration!) 



"Aliasing Applet" <http://cnx.org/content/mll448/latest/> 
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Figure 1.76: The spectrum X s . Sampling frequency is too low. 



To avoid aliasing we have to sample fast enough. But if we can't sample fast enough (possibly due to 
costs) we can include an Anti-Aliasing filter. This will not able us to get an exact reconstruction but can 
still be a good solution. 

note: Typically a low-pass filter that is applied before sampling to ensure that no components 
with frequencies greater than half the sample frequency remain. 

Example 1.22 
The stagecoach effect 

In older western movies you can observe aliasing on a stagecoach when it starts to roll. At first 
the spokes appear to turn forward, but as the stagecoach increase its speed the spokes appear to 
turn backward. This comes from the fact that the sampling rate, here the number of frames per 
second, is too low. We can view each frame as a sample of an image that is changing continuously 
in time. (Applet illustrating the stagecoach effect 73 ) 



1.6.3.3 Reconstruction 

Given the signal in Figure 1.75 we want to recover the original signal, but the question is how? 

When there is no overlapping in the spectrum, the spectral component given by k = (see (1.166)), is 
equal to the spectrum of the analog signal. This offers an oppurtunity to use a simple reconstruction process. 
Remember what you have learned about filtering. What we want is to change signal in Figure 1.75 into 
that of Figure 1.74. To achieve this we have to remove all the extra components generated in the sampling 
process. To remove the extra components we apply an ideal analog low-pass filter as shown in Figure 1.77 
As we see the ideal filter is rectangular in the frequency domain. A rectangle in the frequency domain 
corresponds to a sine 74 function in time domain (and vice versa). 

73 http://flowers. ofthenight.org/wagonWheel/ wagonWheel.html 
74 http://ccrma- www.stanford.edu/~jos/Interpolation/sinc_function.html 
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Figure 1.77: H (iQ) The ideal reconstruction filter. 



Then we have reconstructed the original spectrum, and as we know if two signals are identical in 
the frequency domain, they are also identical in the time domain. End of reconstruction. 

1.6.3.4 Conclusions 

The Shannon sampling theorem requires that the input signal prior to sampling is band-limited to at most 
half the sampling frequency. Under this condition the samples give an exact signal representation. It is truly 
remarkable that such a broad and useful class signals can be represented that easily! 

We also looked into the problem of reconstructing the signals form its samples. Again the simplicity of 
the principle is striking: linear filtering by an ideal low-pass filter will do the job. However, the ideal filter 
is impossible to create, but that is another story... 

1.6.3.5 

Go to? Introduction (Section 1.6.1); Proof (Section 1.6.2); Illustrations (Section 1.6.3); Matlab Example 75 ; 
Aliasing applet 76 ; Hold operation 77 ; System view (Section 1.6.4); Exercises 78 



1.6.4 Systems view of sampling and reconstruction 79 

1.6.4.1 Ideal reconstruction system 

Figure 1.78 shows the ideal reconstruction system based on the results of the Sampling theorem proof 
(Section 1.6.2). 

Figure 1.78 consists of a sampling device which produces a time-discrete sequence x s (n). The recon- 
struction filter, h (t), is an ideal analog sine 80 filter, with h (t) = sine I -^ ) . We can't apply the time-discrete 
sequence x s (n) directly to the analog filter h (t). To solve this problem we turn the sequence into an analog 
signal using delta functions 81 . Thus we write x s (t) = Yl^L-oo x s ( n ) ^ {t — nT). 



75 "Sampling and reconstruction with Matlab" <http://cnx.org/content/mll549/latest/> 

76 "Aliasing Applet" <http://cnx.org/content/mll448/latest/> 

77 "Hold operation" <http://cnx.org/content/mll458/latest/> 

78 "Exercises" <http://cnx.org/content/mll442/latest/> 

79 This content is available online at <http://cnx.Org/content/mll465/l.20/>. 

80 http://ccrma- www.stanford.edu/~jos/Interpolation/sinc_function.html 

81 "Table of Formulas" <http://cnx.org/content/mll450/latest/> 
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Figure 1.78: Ideal reconstruction system 



But when will the system produce an output x (t) = x (£)? According to the sampling theorem (Sec- 
tion 1.6.1.4: The Sampling Theorem) we have x (t) = x (t) when the sampling frequency, F s , is at least twice 
the highest frequency component of x (t). 

1.6.4.2 Ideal system including anti-aliasing 

To be sure that the reconstructed signal is free of aliasing it is customary to apply a lowpass filter, an 
anti-aliasing filter (p. 94), before sampling as shown in Figure 1.79. 




Figure 1.79: Ideal reconstruction system with anti-aliasing filter (p. 94) 



Again we ask the question of when the system will produce an output x (t) = s (£)? If the signal is entirely 
confined within the passband of the lowpass filter we will get perfect reconstruction if F s is high enough. 

But if the anti-aliasing filter removes the "higher" frequencies, (which in fact is the job of the anti-aliasing 
filter), we will never be able to exactly reconstruct the original signal, s (t). If we sample fast enough we 
can reconstruct x(t), which in most cases is satisfying. 

The reconstructed signal, x (£), will not have aliased frequencies. This is essential for further use of the 
signal. 



1.6.4.3 Reconstruction with hold operation 

To make our reconstruction system realizable there are many things to look into. Among them are the fact 
that any practical reconstruction system must input finite length pulses into the reconstruction filter. This 
can be accomplished by the hold operation 82 . To alleviate the distortion caused by the hold opeator we 
apply the output from the hold device to a compensator. The compensation can be as accurate as we wish, 
this is cost and application consideration. 



"Hold operation" <http://cnx.org/content/mll458/latest/> 



97 



*tf) 


Sajtiptmg 


jj{n) 


Hold 




Compensate 




KO 


x(0 













Figure 1.80: More practical reconstruction system with a hold component 8 



By the use of the hold component the reconstruction will not be exact, but as mentioned above we can 
get as close as we want. 

1.6.4.4 

Introduction (Section 1.6.1); Proof (Section 1.6.2); Illustrations (Section 1.6.3); Matlab example 84 ; Hold 
operation 85 ; Aliasing applet 86 ; Exercises 87 

1.6.5 Sampling CT Signals: A Frequency Domain Perspective 88 

1.6.5.1 Understanding Sampling in the Frequency Domain 

We want to relate x c (t) directly to x [n\. Compute the CTFT of 



x s (t) = \_, x c (nT) 6 (t — nT) 



X s (n) = J? 00 T,'Z = _ 00 x c (nT)6(t-nT)e<-- i ) nt dt 

= E~_oo*[«]e ( - i)wn 
= X(u>) 

where uj = VLT and X (u>) is the DTFT of x [n\. 

NOTE: 

x s (n) = ^ ]T x c (n-m s ) 



T 



(1.167) 



A; — — oo 



— ! V^°° v ( oJ-2nk \ 

— T l^k=-oo A c\ T I 

where this last part is 27r-periodic. 

83 "Hold operation" <http://cnx.org/content/mll458/latest/> 

84 "Sampling and reconstruction with Matlab" <http://cnx.org/content/mll549/latest/> 

85 "Hold operation" <http://cnx.org/content/mll458/latest/> 

86 "Aliasing Applet" <http://cnx.org/content/mll448/latest/> 

87 "Exercises" <http://cnx.org/content/mll442/latest/> 

88 This content is available online at <http://cnx.Org/content/ml0994/2.2/>. 



(1.168) 



98 



CHAPTER 1. SIGNALS AND SYSTEMS IN COMMUNICATIONS 



1.6.5.1.1 Sampling 
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Figure 1.81 



Example 1.23: Speech 

Speech is intelligible if bandlimited by a CT lowpass filter to the band ±4 kHz. We can sample 
speech as slowly as ? 
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Figure 1.82 
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Figure 1.83: Note that there is no mention of T or Q s 



1.6.5.2 Relating x[n] to sampled x(t) 

Recall the following equality: 

x s (t) = ^x (nT) 5{t- nT) 
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Figure 1.84 



Recall the CTFT relation: 



x (at) <-» —X 



where a is a scaling of time and — is a scaling in frequency. 

x s (o) = x (or) 



(1.169) 



(1.170) 



1.7 Time Domain Analysis of Discrete Time Systems 

1.7.1 Discrete-Time Systems in the Time-Domain 89 

A discrete-time signal s (n) is delayed by no samples when we write s (n — no), with no > 0. Choosing no 
to be negative advances the signal along the integers. As opposed to analog delays 90 , discrete-time delays 
can only be integer valued. In the frequency domain, delaying a signal corresponds to a linear phase shift 
of the signal's discrete-time Fourier transform: s (n — no) <-» e -( t27T f n o)g (e 1 ' 2 '*?). 
Linear discrete-time systems have the superposition property. 



S (a\X\ (n) + a 2 x 2 (n)) = aiS (xi (n)) + a 2 S (x 2 (n)) 



(1.171) 



89 This content is available online at <http://cnx.Org/content/ml0251/2.24/>. 
90 "Simple Systems": Section Delay <http://cnx.0rg/content/mOOO6/latest/#delay> 
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A discrete-time system is called shift-invariant (analogous to time-invariant analog systems 91 ) if delaying 
the input delays the corresponding output. If S (x (n)) = y (n), then a shift-invariant system has the property 

S (x (n - n )) = y (n - n ) (1.172) 

We use the term shift-invariant to emphasize that delays can only have integer values in discrete-time, while 
in analog signals, delays can be arbitrarily valued. 

We want to concentrate on systems that are both linear and shift-invariant. It will be these that allow us 
the full power of frequency-domain analysis and implementations. Because we have no physical constraints 
in "constructing" such systems, we need only a mathematical specification. In analog systems, the differ- 
ential equation specifies the input-output relationship in the time-domain. The corresponding discrete-time 
specification is the difference equation. 

y (n) = aiy (n — 1) + • ■ ■ + a p y (n — p) + box (n) + b\X (n — 1) + ■ ■ ■ + b q x (n — q) (1.173) 

Here, the output signal y (n) is related to its past values y (n — I), I = {1, . . . ,p}, and to the current and 
past values of the input signal x(n). The system's characteristics are determined by the choices for the 
number of coefficients p and q and the coefficients' values {ai, . . . , a p } and {bo, b\, . . . , b q }. 

aside: There is an asymmetry in the coefficients: where is ao? This coefficient would multiply the 
y (n) term in (1.173). We have essentially divided the equation by it, which does not change the 
input-output relationship. We have thus created the convention that ao is always one. 

As opposed to differential equations, which only provide an implicit description of a system (we must 
somehow solve the differential equation), difference equations provide an explicit way of computing the 
output for any input. We simply express the difference equation by a program that calculates each output 
from the previous output values, and the current and previous inputs. 

Difference equations are usually expressed in software with for loops. A MATLAB program that would 
compute the first 1000 values of the output has the form 

for n=l:1000 

y(n) = sum(a. *y (n-1 : -1 :n-p) ) + sum(b. *x(n: -1 :n-q) ) ; 
end 

An important detail emerges when we consider making this program work; in fact, as written it has (at least) 
two bugs. What input and output values enter into the computation of y(l)? We need values for y(0), 
y (— 1), ..., values we have not yet computed. To compute them, we would need more previous values of the 
output, which we have not yet computed. To compute these values, we would need even earlier values, ad 
infinitum. The way out of this predicament is to specify the system's initial conditions: we must provide 
the p output values that occurred before the input started. These values can be arbitrary, but the choice 
does impact how the system responds to a given input. One choice gives rise to a linear system: Make the 
initial conditions zero. The reason lies in the definition of a linear system 92 : The only way that the output 
to a sum of signals can be the sum of the individual outputs occurs when the initial conditions in each case 
are zero. 

Exercise 1.7.1.1 (Solution on p. 142.) 

The initial condition issue resolves making sense of the difference equation for inputs that start at 
some index. However, the program will not work because of a programming, not conceptual, error. 
What is it? How can it be "fixed?" 

91 "Simple Systems" <http://cnx.Org/content/m0006/latest/#para4wra> 

92 "Simple Systems": Section Linear Systems <http://cnx.0rg/content/mOOO6/latest/#linearsys> 
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Example 1.24 

Let's consider the simple system having p = 1 and q = 0. 

y (n) = ay (n — 1) + bx (n) 



(1.174) 



To compute the output at some index, this difference equation says we need to know what the 
previous output y (n — 1) and what the input signal is at that moment of time. In more detail, let's 
compute this system's output to a unit-sample input: x (n) = 5 (n). Because the input is zero for 
negative indices, we start by trying to compute the output at n = 0. 



y (0) = ay (-1) + b 



(1.175) 



What is the value of y (—1)? Because we have used an input that is zero for all negative indices, it 
is reasonable to assume that the output is also zero. Certainly, the difference equation would not 
describe a linear system 93 if the input that is zero for all time did not produce a zero output. With 
this assumption, y{— 1) = 0, leaving y (0) = b. For n > 0, the input unit-sample is zero, which 
leaves us with the difference equation \/n,n > : (y (ri) = ay (n — 1)). We can envision how the 
filter responds to this input by making a table. 



y (n) = ay (n — 1) + bd (n) 



(1.176) 



n 


x (n) 


y(n) 


-1 











1 


b 


1 





ba 


2 





ba 2 









n 





ba n 



Table 1.4 

Coefficient values determine how the output behaves. The parameter b can be any value, and 
serves as a gain. The effect of the parameter o is more complicated (Table 1.4). If it equals zero, 
the output simply equals the input times the gain b. For all non-zero values of a, the output 
lasts forever; such systems are said to be IIR (Infinite Impulse Response). The reason for this 
terminology is that the unit sample also known as the impulse (especially in analog situations), and 
the system's response to the "impulse" lasts forever. If a is positive and less than one, the output 
is a decaying exponential. When a = 1, the output is a unit step. If a is negative and greater 
than —1, the output oscillates while decaying exponentially. When o = — 1, the output changes 
sign forever, alternating between b and —b. More dramatic effects when \a\ > 1; whether positive 
or negative, the output signal becomes larger and larger, growing exponentially. 



"Simple Systems": Section Linear Systems <http://cnx.0rg/content/mOOO6/latest/#linearsys> 
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Figure 1.85: The input to the simple example system, a unit sample, is shown at the top, with the 
outputs for several system parameter values shown below. 



Positive values of a are used in population models to describe how population size increases 
over time. Here, n might correspond to generation. The difference equation says that the number 
in the next generation is some multiple of the previous one. If this multiple is less than one, the 
population becomes extinct; if greater than one, the population flourishes. The same difference 
equation also describes the effect of compound interest on deposits. Here, n indexes the times at 
which compounding occurs (daily, monthly, etc.), a equals the compound interest rate plus one, 
and 6=1 (the bank provides no gain). In signal processing applications, we typically require that 
the output remain bounded for any input. For our example, that means that we restrict \a\ < 1 
and chose values for it and the gain according to the application. 

Exercise 1.7.1.2 (Solution on p. 142.) 

Note that the difference equation (1.173), 

y (n) = aiy (n — 1) + • • • + a p y (n - p) + b x (n) + bix (n — 1) + • • • + b q x (n - q) 

does not involve terms like y (n + 1) or x (n + 1) on the equation's right side. Can such terms also 
be included? Why or why not? 
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Figure 1.86: The plot shows the unit-sample response of a length-5 boxcar filter. 
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Example 1.25 

A somewhat different system has no "a" coefficients. Consider the difference equation 

y(n)= -(x(n)-\ \- x (n - q + 1)) (1.177) 

q 

Because this system's output depends only on current and previous input values, we need not 
be concerned with initial conditions. When the input is a unit-sample, the output equals - for 
n = {0, . . . , q — 1}, then equals zero thereafter. Such systems are said to be FIR (Finite Impulse 
Response) because their unit sample responses have finite duration. Plotting this response (Fig- 
ure 1.86) shows that the unit-sample response is a pulse of width q and height -. This waveform 
is also known as a boxcar, hence the name boxcar filter given to this system. We'll derive its 
frequency response and develop its filtering interpretation in the next section. For now, note that 
the difference equation says that each output value equals the average of the input's current and 
previous values. Thus, the output equals the running average of input's previous q values. Such a 
system could be used to produce the average weekly temperature (q = 7) that could be updated 
daily. 

[Media Object] 94 

1.7.2 Discrete Time Convolution 95 

1.7.2.1 Introduction 

Convolution, one of the most important concepts in electrical engineering, can be used to determine the 
output a system produces for a given input signal. It can be shown that a linear time invariant system is 
completely characterized by its impulse response. The sifting property of the discrete time impulse function 
tells us that the input signal to a system can be represented as a sum of scaled and shifted unit impulses. 
Thus, by linearity, it would seem reasonable to compute of the output signal as the sum of scaled and shifted 
unit impulse responses. That is exactly what the operation of convolution accomplishes. Hence, convolution 
can be used to determine a linear time invariant system's output from knowledge of the input and the impulse 
response. 

1.7.2.2 Convolution and Circular Convolution 
1.7.2.2.1 Convolution 

1.7.2.2.1.1 Operation Definition 

Discrete time convolution is an operation on two discrete time signals defined by the integral 

oo 

(f*g)(n)= Y, f(k)g(n-k) (1.178) 

k — — oo 

for all signals /, g defined on Z. It is important to note that the operation of convolution is commutative, 
meaning that 

f*9 = 9*f (1-179) 



94 This media object is a Lab VIEW VI. Please view or download it at 
<DiscreteTimeSys.llb> 



<>-, 



This content is available online at <http://cnx.Org/content/ml0087/2.27/>. 
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for all signals /, g defined on Z. Thus, the convolution operation could have been just as easily stated using 
the equivalent definition 

oo 

(f*g)(n)= ]T f(n-k)g(k) (1.180) 

k — — oo 

for all signals f,g defined on Z. Convolution has several other important properties not listed here but 
explained and derived in a later module. 

1.7.2.2.1.2 Definition Motivation 

The above operation definition has been chosen to be particularly useful in the study of linear time invariant 
systems. In order to see this, consider a linear time invariant system H with unit impulse response h. Given 
a system input signal x we would like to compute the system output signal H (x). First, we note that the 
input can be expressed as the convolution 

oo 

x{n)= Y^ x{k)5{n-k) (1.181) 

k— — oo 

by the sifting property of the unit impulse function. By linearity 

oo 

Hx{n)= Y, x{k)H5{n-k). (1.182) 

k — — oo 

Since H 5 (n — k) is the shifted unit impulse response h(n — fc), this gives the result 

oo 

Hx{n)= Y x(k)h(n-k) = (x*h)(n). (1.183) 

k— — oo 

Hence, convolution has been defined such that the output of a linear time invariant system is given by the 
convolution of the system input with the system unit impulse response. 

1.7.2.2.1.3 Graphical Intuition 

It is often helpful to be able to visualize the computation of a convolution in terms of graphical processes. 
Consider the convolution of two functions /, g given by 

oo oo 

{f*g){n)= Y f(k)g(n-k)= Y f(n-k)g(k). (1.184) 

k — — oo k=— oo 

The first step in graphically understanding the operation of convolution is to plot each of the functions. 
Next, one of the functions must be selected, and its plot reflected across the k = axis. For each real t, that 
same function must be shifted left by t. The product of the two resulting plots is then constructed. Finally, 
the area under the resulting curve is computed. 

Example 1.26 

Recall that the impulse response for a discrete time echoing feedback system with gain a is 

h (n) = a n u (n) , (1.185) 

and consider the response to an input signal that is another exponential 

x{n) = b n u{n). (1.186) 
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We know that the output for this input is given by the convolution of the impulse response with 
the input signal 

y (n) = x (n) * h (n) . (1.187) 

We would like to compute this operation by beginning in a way that minimizes the algebraic 
complexity of the expression. However, in this case, each possible coice is equally simple. Thus, we 
would like to compute 

oo 

y(n)= Y] a k u(k)b n - k u(n-k). (1.188) 

k— — oo 

The step functions can be used to further simplify this sum. Therefore, 

y(n)=0 (1.189) 

for n < and 



(ao" k 

k=0 

for n > 0. Hence, provided ab / 1, we have that 



y(n) = Y J (ab) k (1.190) 



n < 

1 — (ao) — 



1.7.2.2.2 Circular Convolution 

Discrete time circular convolution is an operation on two finite length or periodic discrete time signals defined 
by the integral 

jv-i - 
{f*g){n)=Y J f{k)9{n-k) (1.192) 

fc=0 

for all signals f,g defined on Z [0, N — 1] where /, 5 are periodic extensions of / and g. It is important to 
note that the operation of circular convolution is commutative, meaning that 

f*9 = 9*f (1-193) 

for all signals /, g defined on Z [0, N — 1]. Thus, the circular convolution operation could have been just as 
easily stated using the equivalent definition 

jv-i ~ 
(f*g)(n)= Y f(n-k)g(k) (1.194) 

fe=0 

for all signals /, g defined on Z [0, N — 1] where /, 9 are periodic extensions of / and g. Circular convolution 
has several other important properties not listed here but explained and derived in a later module. 
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Alternatively, discrete time circular convolution can be expressed as the sum of two summations given 
by 

n N-l 

(f*g)(n) = Y.f( k )9(n-k)+ Y, f(k)g(n-k + N) (1.195) 

fe=0 fe=n+l 

for all signals /, g defined on Z [0, N — 1]. 

Meaningful examples of computing discrete time circular convolutions in the time domain would involve 
complicated algebraic manipulations dealing with the wrap around behavior, which would ultimately be 
more confusing than helpful. Thus, none will be provided in this section. Of course, example computations 
in the time domain are easy to program and demonstrate. However, disrete time circular convolutions are 
more easily computed using frequency domain tools as will be shown in the discrete time Fourier series 
section. 

1.7.2.2.2.1 Definition Motivation 

The above operation definition has been chosen to be particularly useful in the study of linear time invariant 
systems. In order to see this, consider a linear time invariant system H with unit impulse response h. Given 
a finite or periodic system input signal x we would like to compute the system output signal H (x). First, 
we note that the input can be expressed as the circular convolution 



JV-l 

x ' 

fc=0 



(n)=^2 x (k) S (n-k) (1.196) 



by the sifting property of the unit impulse function. By linearity, 

N-l „ 



Hx{n)= J2 x {k)H 5 {n-k) . (1.197) 



fe=0 



Since HS (n — k) is the shifted unit impulse response h(n — k), this gives the result 



N-l 



Hx (n)=Y J x ( k ) h{n-k) = {x*h) (n) . (1.198) 

fc=0 

Hence, circular convolution has been defined such that the output of a linear time invariant system is given 
by the convolution of the system input with the system unit impulse response. 

1.7.2.2.2.2 Graphical Intuition 

It is often helpful to be able to visualize the computation of a circular convolution in terms of graphical 
processes. Consider the circular convolution of two finite length functions /, g given by 

jv-i - ^ N-l - 

(/ *g)(n) = 22 f W 9 (n-k) = J2 f (n-k) g (k) . (1.199) 

fe=0 fe=0 

The first step in graphically understanding the operation of convolution is to plot each of the periodic 
extensions of the functions. Next, one of the functions must be selected, and its plot reflected across the 
k = axis. For each k € Z [0, N — 1], that same function must be shifted left by k. The product of the two 
resulting plots is then constructed. Finally, the area under the resulting curve on Z [0,7V — 1] is computed. 
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1.7.2.3 Interactive Element 
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Figure 1.87: Interact (when online) with the Mathematica CDF demonstrating Discrete Linear Con- 
volution. To download, right click and save file as .cdf 
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1.7.2.4 Convolution Summary 

Convolution, one of the most important concepts in electrical engineering, can be used to determine the 
output signal of a linear time invariant system for a given input signal with knowledge of the system's unit 
impulse response. The operation of discrete time convolution is defined such that it performs this function 
for infinite length discrete time signals and systems. The operation of discrete time circular convolution is 
defined such that it performs this function for finite length and periodic discrete time signals. In each case, 
the output of the system is the convolution or circular convolution of the input signal with the unit impulse 
response. 

1.7.3 Discrete Time Circular Convolution and the DTFS 96 

1.7.3.1 Introduction 

This module relates circular convolution of periodic signals in one domain to multiplication in the other 
domain. 

You should be familiar with Discrete-Time Convolution (Section 1.7.2), which tells us that given two 
discrete-time signals x [n], the system's input, and h [n], the system's response, we define the output of the 
system as 

v\n] = x \n] * h \n\ 

J (1-200) 

= E^L-oo x M h[n-k] 

When we are given two DFTs (finite-length sequences usually of length N), we cannot just multiply them 
together as we do in the above convolution formula, often referred to as linear convolution. Because the 
DFTs are periodic, they have nonzero values for n > N and thus the multiplication of these two DFTs will be 
nonzero for n > N. We need to define a new type of convolution operation that will result in our convolved 
signal being zero outside of the range n = {0, 1, . . . , N — 1}. This idea led to the development of circular 
convolution, also called cyclic or periodic convolution. 

1.7.3.2 Signal Circular Convolution 

Given a signal / [n] with Fourier coefficients c\. and a signal g [n] with Fourier coefficients dk, we can define 
a new signal, v [n], where v [n] = f [n] ® g [n] We find that the Fourier Series 97 representation of v [n], ak, 
is such that ak = Ckdk- f [n] ® g [n] is the circular convolution (Section 1.7.3) of two periodic signals and is 
equivalent to the convolution over one interval, i.e. f [n] ® g [n] = E n =o Erj=o / W 9 i n ~ r i\- 

note: Circular convolution in the time domain is equivalent to multiplication of the Fourier 
coefficients. 



This is proved as follows 

ak = 



hY.L^He-^kn) 



N 



V„, v = n - V : (i Ejlo / [r,] (> £?=.?„ 9 M e~^<>^ ; , 
h E^=o / M (> Y!t=\ 9 M e-^A ,-u^M) 

Ckdk 



96 This content is available online at <http://cnx.Org/content/ml0786/2.14/>. 
97 "Fourier Series: Eigenfunction Approach" <http://cnx.org/content/ml0496/latest/> 
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1.7.3.2.1 Circular Convolution Formula 

What happens when we multiply two DFT's together, where Y [k] is the DFT of y [n]l 

Y[k]=F[k]H[k] (1.202) 



when < k < N - 1 

Using the DFT synthesis formula for y [n] 



N-l 

N 



'i\»\ = ^Y, F \ k \ H \^ e3¥kn ( L203 ) 



fe=0 



And then applying the analysis formula F [k] = X^ m =n / [ m ] e< ' "^ ™ kn 



y[n] = ^E^E^/NeW'^^I*] 



e> n ' 



El= f H Uj2k=o H [k] e^(«-H 



(1.204) 



where we can reduce the second summation found in the above equation into h[((n — m)) N ] = 
W^k=o H\k\e^Tr k ^ n ^ m ^ y [n] = ^2 m Z f [m] h [((n — rn)) N ] which equals circular convolution! When we 
have < n < N — lin the above, then we get: 

y [n] = f [n] © h [n] (1.205) 



note: The notation © represents cyclic convolution "mod N". 

1.7.3.2.1.1 Alternative Convolution Formula 
Alternative Circular Convolution Algorithm 

• Step 1: Calculate the DFT of / [n] which yields F [k] and calculate the DFT of h [n] which yields H [k]. 

• Step 2: Pointwise multiply Y [k] =F[k]H [k] 

• Step 3: Inverse DFT Y [k] which yields y [n] 

Seems like a roundabout way of doing things, but it turns out that there are extremely fast ways to 
calculate the DFT of a sequence. 

To circularily convolve 2 ./V-point sequences: y [n] = J2 m =o f I TO ] ^ K( n — m ))Af] ^ 0T eac h n : N multiples, 
7V — 1 additions 

N points implies TV 2 multiplications, N (N — 1) additions implies O (N 2 ) complexity. 

1.7.3.2.2 Steps for Circular Convolution 

We can picture periodic 98 sequences as having discrete points on a circle as the domain 



"Continuous Time Periodic Signals" <http://cnx.org/content/ml0744/latest/> 



Ill 



f[n] 



til. -Ik 31 tf 



T 

ifl5| 



1H I 




read off 
values 
ACW 



Figure 1.88 



Shifting by m, / (n+ m), corresponds to rotating the cylinder m notches ACW (counter clockwise). For 
m = —2, we get a shift equal to that in the following illustration: 



fln-2] 



V^ 



.1 . .1 

1 Y^ 




f[2] f[3] 

vector \f[4] f\5] fTO] f[H f\2] f[3] 



Figure 1.89: for m = — 2 
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circular shift 
by-1 



i 



*il 



tin] 



notation for 
circular shift 



f[((nl)) N ] ^ 



indices are 

calculated 

"mod N" 



Figure 1.90 



To cyclic shift we follow these steps: 
1) Write / (n) on a cylinder, ACW 




n=0 



Figure 1.91: N - 
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2) To cyclic shift by to, spin cylinder m spots ACW 

f[n]^f[((n + m)) N ] 




H3] ■+ 



n=0 



Figure 1.92: m = -3 



1.7.3.2.2.1 Notes on circular shifting 

/ [((n + -/V))^] = / [n] Spinning N spots is the same as spinning all the way around, or not spinning at all. 
/ \{{n + N)) N ] = f [((n - {N - m))) N ] Shifting ACW to is equivalent to shifting CW N - to 
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Figure 1.93 



/ [(( — n ))jv] The above expression, simply writes the values of / [n] clockwise. 



<1&] 



II 4 1 




no] a — n=o 



■v-i 




flO] A 11=0 



IK- 1 



H2] 



(a) 



(b) 



Figure 1.94: (a) / [n] (b) / [((-n)) f 
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Example 1.27: Convolve (n = 4) 



f[n] 

ft' o 

^ 1 1 — v. 


*! 


f 



h[nl 



♦ '♦' 





-• — • > n 



(a) (b) 

Figure 1.95: Two discrete-time signals to be convolved. 



M((-(m()0 



AM 



h[((m)) 1 



«— ■ • — ' ^ n 



Figure 1.96 



Multiply / [m] and sum to yield: y [0] = 3 
. M((l (-("»()()*] 



h[((l-m» N ] 



-t~> * n 



Figure 1.97 



Multiply / [m] and sum to yield: y [1] = 5 

. h[((2(-(m()() N } 
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h[«2-m»J 



<^t> 



-* ^ n 



Figure 1.98 



Multiply / [m] and sum to yield: y [2] = 3 

. M((3(-(m()(U 



h[((3-m)) N l 
+ l 



^>-«- 



-^ n 



Figure 1.99 



Multiply / [m] and sum to yield: y [3] = 1 



1.7.3.2.3 Exercise 

Take a look at a square pulse with a period of T. 



For this signal c& 



^ if fc = 

\ — jHr - otherwise 



Take a look at a triangle pulse train with a period of T. 

This signal is created by circularly convolving the square pulse with itself. The Fourier coefficients for 
this signal are au = Ck 2 = \ /"",■> 

Exercise 1.7.3.1 (Solution on p. 142.) 

Find the Fourier coefficients of the signal that is created when the square pulse and the triangle 
pulse are convolved. 



1.7.3.3 Circular Shifts and the DFT 

Theorem 1.2: Circular Shifts and DFT 

If / [n] «-» F [k] then / [((n — m)) N ] <-» e~^ w m >F[k] (i.e. circular shift in time domain = 
phase shift in DFT) 
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Proof: 



f[n] 



1 N ^ 

-Y 

k=0 



F[k]e 



i-rrkn 



so phase shifting the DFT 



f[n] 



f[((n-m)) N ] 



sE^fH^'^ 



(1.206) 



(1.207) 



1.7.3.4 Circular Convolution Demonstration 



H Rotation rig j~~J0 
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\/liLSI=l 


N«=l >v/ 




Figure 1.100: Interact (when online) with a Mathematica CDF demonstrating Circular Shifts. 



1.7.3.5 Conclusion 

Circular convolution in the time domain is equivalent to multiplication of the Fourier coefficients in the 
frequency domain. 
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1.8 Discrete Time Fourier Transform (DTFT) 
1.8.1 Discrete Time Fourier Transform (DTFT) 99 

1.8.1.1 Introduction 

In this module, we will derive an expansion for arbitrary discrete-time functions, and in doing so, derive the 
Discrete Time Fourier Transform (DTFT). 

Since complex exponentials (Section 1.1.5) are eigenfunctions of linear time-invariant (LTI) systems 100 , 
calculating the output of an LTI system H given e tujn as an input amounts to simple multiplication, where 
uj = 2^5 t anc j where H [k] S C is the eigenvalue corresponding to k. As shown in the figure, a simple 
exponential input would yield the output 

y[n] = H [k] e luJn (1.208) 



H. 



H[k] 



..■- 



Figure 1.101: Simple LTI system. 



Using this and the fact that TL is linear, calculating y [n] for combinations of complex exponentials is 
also straightforward. 

Cie *»i» + C2e ^» -> Cl H [An] e^ 1 ™ + c 2 H \k 2 ] e l ^ n 

i i 

The action of H on an input such as those in the two equations above is easy to explain. H inde- 
pendently scales each exponential component e tUin by a different complex number H [ki] G C. As such, if 
we can write a function y [n] as a combination of complex exponentials it allows us to easily calculate the 
output of a system. 

Now, we will look to use the power of complex exponentials to see how we may represent arbitrary signals 
in terms of a set of simpler functions by superposition of a number of complex exponentials. Below we will 
present the Discrete-Time Fourier Transform (DTFT). Because the DTFT deals with nonperiodic 
signals, we must find a way to include all real frequencies in the general equations. For the DTFT we simply 
utilize summation over all real numbers rather than summation over integers in order to express the aperiodic 
signals. 

"This content is available online at <http://cnx.Org/content/ml0108/2.18/>. 
100 "Eigenfunctions of LTI Systems" <http://cnx.org/content/ml0500/latest/> 
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1.8.1.2 DTFT synthesis 

It can be demonstrated that an arbitrary Discrete Time-periodic function / [n] can be written as a linear 
combination of harmonic complex sinusoids 

N-l 

k=o 

where ujq = ^ is the fundamental frequency. For almost all / [n] of practical interest, there exists c„ to 
make (1.209) true. If / [n] is finite energy ( / [n] € L 2 [0, N]), then the equality in (1.209) holds in the sense 
of energy convergence; with discrete-time signals, there are no concerns for divergence as there are with 
continuous-time signals. 

The c n - called the Fourier coefficients - tell us "how much" of the sinusoid e- J "° fcn is in / [n]. The formula 
shows / [n] as a sum of complex exponentials, each of which is easily processed by an LTI system (since it 
is an eigenfunction of every LTI system). Mathematically, it tells us that the set of complex exponentials 
{V/c, k g Z : (e?'*' )} form a basis for the space of N-periodic discrete time functions. 

1.8.1.2.1 Equations 

Now, in order to take this useful tool and apply it to arbitrary non-periodic signals, we will have to delve 
deeper into the use of the superposition principle. Let st (t) be a periodic signal having period T. We want 
to consider what happens to this signal's spectrum as the period goes to infinity. We denote the spectrum 
for any assumed value of the period by c„ (T). We calculate the spectrum according to the Fourier formula 
for a periodic signal, known as the Fourier Series (for more on this derivation, see the section on Fourier 
Series.) 



1 rT 



Tjo 



s (t) exp (-6w i) dt (1.210) 



where u>q = ^ and where we have used a symmetric placement of the integration interval about the origin 
for subsequent derivational convenience. We vary the frequency index n proportionally as we increase the 
period. Define 

S T (!) = Tc n =l- [ (S T (f) exp (6w t) d*(1.211) 
1 Jo 

making the corresponding Fourier Series 

oo 

st (t) = J2f (*) ex P (^ot) ^ (1.212) 

As the period increases, the spectral lines become closer together, becoming a continuum. Therefore, 

oo 

Urn s T (t) = s (t) = S (f) exp (Quj t) df (1.213) 

T^oo J 

— oo 

with 

oo 

S(f)= fs(t)exp(-Quoi)dt (1.214) 

— OO 

Discrete-Time Fourier Transform 

oo 

j»= Yl /W e_M (!- 215 ) 
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Inverse DTFT 



f[n] 



2-k 



?{u)e wn duj 



(1.216) 



warning: It is not uncommon to see the above formula written slightly different. One of the most 
common differences is the way that the exponential is written. The above equations use the radial 
frequency variable u) in the exponential, where to = 2irf, but it is also common to include the more 
explicit expression, 11% ft, in the exponential. Sometimes DTFT notation is expressed as F (e lw ), 
to make it clear that it is not a CTFT (which is denoted as F (fi)). Click here 101 for an overview 
of the notation used in Connexion's DSP modules. 

1.8.1.3 DTFT Definition demonstration 







DTFT Definition 
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Figure 1.102: Click on the above thumbnail image (when online) to download an interactive Mathe- 
matica Player demonstrating Discrete Time Fourier Transform. To Download, right-click and save target 
as .cdf. 



1.8.1.4 DTFT Summary 

Because complex exponentials are eigenfunctions of LTI systems, it is often useful to represent signals using 
a set of complex exponentials as a basis. The discrete time Fourier transform synthesis formula expresses a 
discrete time, aperiodic function as the infinite sum of continuous frequency complex exponentials. 



J» 



E 



f[n]e 



— (iujri) 



(1.217) 



"DSP notation" <http://cnx.org/content/ml0161/latest/> 
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The discrete time Fourier transform analysis formula takes the same discrete time domain signal and 
represents the signal in the continuous frequency domain. 

f[n\ = ^- C T{oj)e iun du: (1.218) 



1.8.2 Properties of the DTFT 102 

1.8.2.1 Introduction 

This module will look at some of the basic properties of the Discrete- Time Fourier Transform (Section 1.8.1) 
(DTFT). 

note: We will be discussing these properties for aperiodic, discrete-time signals but understand 
that very similar properties hold for continuous-time signals and periodic signals as well. 

1.8.2.2 Discussion of Fourier Transform Properties 

1.8.2.2.1 Linearity 

The combined addition and scalar multiplication properties in the table above demonstrate the basic property 
of linearity. What you should see is that if one takes the Fourier transform of a linear combination of signals 
then it will be the same as the linear combination of the Fourier transforms of each of the individual signals. 
This is crucial when using a table (Section 1.8.7) of transforms to find the transform of a more complicated 
signal. 

Example 1.28 

We will begin with the following signal: 

z [n] = af\ [n] + bf 2 [n] (1.219) 

Now, after we take the Fourier transform, shown in the equation below, notice that the linear 
combination of the terms is unaffected by the transform. 

Z (w) = aFi (w) + bF 2 (w) (1.220) 



1.8.2.2.2 Symmetry 

Symmetry is a property that can make life quite easy when solving problems involving Fourier transforms. 
Basically what this property says is that since a rectangular function in time is a sine function in frequency, 
then a sine function in time will be a rectangular function in frequency. This is a direct result of the similarity 
between the forward DTFT and the inverse DTFT. The only difference is the scaling by 2ir and a frequency 
reversal. 



2 This content is available online at <http://cnx.Org/content/m0506/2.7/>. 
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1.8.2.2.3 Time Scaling 

This property deals with the effect on the frequency-domain representation of a signal if the time variable 
is altered. The most important concept to understand for the time scaling property is that signals that are 
narrow in time will be broad in frequency and vice versa. The simplest example of this is a delta function, 
a unit pulse 103 with a very small duration, in time that becomes an infinite-length constant function in 
frequency. 

The table above shows this idea for the general transformation from the time-domain to the frequency- 
domain of a signal. You should be able to easily notice that these equations show the relationship mentioned 
previously: if the time variable is increased then the frequency range will be decreased. 

1.8.2.2.4 Time Shifting 

Time shifting shows that a shift in time is equivalent to a linear phase shift in frequency. Since the frequency 
content depends only on the shape of a signal, which is unchanged in a time shift, then only the phase 
spectrum will be altered. This property is proven below: 

Example 1.29 

We will begin by letting z[n] = f \n — rj\. Now let us take the Fourier transform with the previous 
expression substituted in for z [n]. 

f'OO 

Z{uj)= f[n-rf\e~ {lu)n) dn (1.221) 



Now let us make a simple change of variables, where a = n — r\. Through the calculations below, 
you can see that only the variable in the exponential are altered thus only changing the phase in 
the frequency domain. 

Z (to) = J^f [a] e-lM'+vWdq 

= e-( ita "») /!^ / [a] e-^^da (1.222) 

= e -(i*r,)F (w) 



1.8.2.2.5 Convolution 

Convolution is one of the big reasons for converting signals to the frequency domain, since convolution in 
time becomes multiplication in frequency. This property is also another excellent example of symmetry 
between time and frequency. It also shows that there may be little to gain by changing to the frequency 
domain when multiplication in time is involved. 

We will introduce the convolution integral here, but if you have not seen this before or need to refresh your 
memory, then look at the discrete-time convolution (Section 1.7.2) module for a more in depth explanation 
and derivation. 

y[n] = (AH.AW) (1223) 

= E^L-oo h M h [n - rj\ 



"Elemental Signals": Section Pulse <http://cnx.Org/content/m0004/latest/#pulsedef> 
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1.8.2.2.6 Time Differentiation 

Since LTI (Section 1.2.1) systems can be represented in terms of differential equations, it is apparent with 
this property that converting to the frequency domain may allow us to convert these complicated differential 
equations to simpler equations involving multiplication and addition. This is often looked at in more detail 
during the study of the Z Transform 104 . 

1.8.2.2.7 Parseval's Relation 

°° /.7T 

£ (l/WD 2 = / (l*»l) 2 ^ (1-224) 

Parseval's relation tells us that the energy of a signal is equal to the energy of its Fourier transform. 



Figure 1.103 



1.8.2.2.8 Modulation (Frequency Shift) 

Modulation is absolutely imperative to communications applications. Being able to shift a signal to a different 
frequency, allows us to take advantage of different parts of the electromagnetic spectrum is what allows us 
to transmit television, radio and other applications through the same space without significant interference. 
The proof of the frequency shift property is very similar to that of the time shift (Section 1.8.2.2.4: Time 
Shifting); however, here we would use the inverse Fourier transform in place of the Fourier transform. Since 
we went through the steps in the previous, time-shift proof, below we will just show the initial and final step 
to this proof: 

i r°° 

z(t) = — F(u-4))e luJt duj (1.225) 

2tt J_ 00 

Now we would simply reduce this equation through another change of variables and simplify the terms. 
Then we will prove the property expressed in the table above: 

z(t) = f(t)e^ (1.226) 



1.8.2.3 Properties Demonstration 

An interactive example demonstration of the properties is included below: 



"The Laplace Transform" <http://cnx.org/content/ml0110/latest/> 
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This media object is a Lab VIEW VI. Please view or download it at 
<CTFTSPlab.llb> 

Figure 1.104: Interactive Signal Processing Laboratory Virtual Instrument created using NI's Labview. 



1.8.2.4 Summary Table of DTFT Properties 

Discrete-Time Fourier Transform Properties 





Sequence Domain 


Frequency Domain 


Linearity 


aiSi (n) + a 2 s 2 (n) 


aiSi (e i2 ^) + a 2 S 2 (e^f) 


Conjugate Symmetry 


s (n) real 


S (e a ^) = S (e-(«*/)) 


Even Symmetry 


s (n) = s (— n) 


S (e^f) = S (e-«^)) 


Odd Symmetry 


s (n) = —s (—n) 


S (e i2 *f) = -S (e-( i2ff /)) 


Time Delay 


s(n- n ) 


e -(i2TTfn ) S f e i2Kf\ 


Multiplication by n 


ns (n) 


! dS(e* a ^) 


-(2«r) df 


Sum 


J2n=-oo S (») 


5 (e i2OT °) 


Value at Origin 


*(0) 


/_\ 5 (e* 2 *') rf/ 


Parseval's Theorem 


£~_oo(K«)l) 2 


/Ji(|5(e«'0l)V 


Complex Modulation 


e i2nf n s (^ 


^ («,«*(/-/„)) 


Amplitude Modulation 


s (n) cos (27r/o^) 


5( e i^(/-/o)) +5 ( e "-(/ + /o)) 
2 




s (n) sin (2irfon) 


2» 



Table 1.5: Discrete-time Fourier transform properties and relations. 



1.8.3 Discrete Time Fourier Transform Pair 105 

When we obtain the discrete-time signal via sampling an analog signal, the Nyquist frequency corresponds 
to the discrete-time frequency | . To show this, note that a sinusoid at the Nyquist frequency -^r~ nas a 
sampled waveform that equals 

Sinusoid at Nyquist Frequency 1/2T 



cos ( 2tt x -^rnT s 



The exponential in the DTFT at frequency 4 equals e~ 



cos (nn) 
(-1)" 



-(inn) 



correspondence between analog and discrete-time frequency is established: 
Analog, Discrete-Time Frequency Relationship 

Id = JaT s 



(1.227) 
( — 1)™ , meaning that the 

(1.228) 



5 This content is available online at <http://cnx.Org/content/m0525/2.7/>. 
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where fo and Ja represent discrete-time and analog frequency variables, respectively. The aliasing 
figure 106 provides another way of deriving this result. As the duration of each pulse in the periodic sampling 
signal pr s (t) narrows, the amplitudes of the signal's spectral repetitions, which are governed by the Fourier 
series coefficients of px s (t) , become increasingly equal. 107 Thus, the sampled signal's spectrum becomes 
periodic with period ^- . Thus, the Nyquist frequency ^- corresponds to the frequency \ . 

The inverse discrete-time Fourier transform is easily derived from the following relationship: 

l-n r \ - r 1 if m = fl 

e -(z2Kfm) e znfn d f = J ^ (1.229) 

if m j£ n 
Therefore, we find that 

J\_S(e t2v f)e t27r f n df = fKj2 mm s (m)e~ {i27rfm) e i27rfnd f 

= Zm m s(m)jKe^ i2 *W m - n Uf (1-230) 

2 

= s (n) 

The Fourier transform pairs in discrete-time are 
Fourier Transform Pairs in Discrete Time 

S (e l27rf ) = £) * (n) e~ (42T/n) (1.231) 

■nn 

Fourier Transform Pairs in Discrete Time 

i 

s(n)= T S(e l2lTf )e i2lTfn df (1.232) 

•'-5 

1.8.4 DTFT Examples 108 

Example 1.30 

Let's compute the discrete-time Fourier transform of the exponentially decaying sequence s (n) = 
a n u (n) , where u (n) is the unit-step sequence. Simply plugging the signal's expression into the 
Fourier transform formula, 

Fourier Transform Formula 

This sum is a special case of the geometric series. 
Geometric Series 




Va,H<l: > a n = (1.234) 



106 "The Sampling Theorem", Figure 2: aliasing <http://cnx.Org/content/m0050/latest/#alias> 

107 Examination of the periodic pulse signal reveals that as A decreases, the value of co , the largest Fourier coefficient, decreases 
to zero: |co| = 4^ . Thus, to maintain a mathematically viable Sampling Theorem, the amplitude A must increase as ^ , 
becoming infinitely large as the pulse duration decreases. Practical systems use a small value of A , say 0.1T S and use amplifiers 
to rescale the signal. 
108 This content is available online at <http://cnx.Org/content/m0524/2.ll/>. 
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Thus, as long as \a\ < 1 , we have our Fourier transform. 

S (e^f) = l — 

v ' I- ae-0 



2*7) 



(1.235) 



Using Euler's relation, we can express the magnitude and phase of this spectrum. 

1 



\S (e* 2 ^) 



yj(l - acos (2tt/)) 2 + a 2 sin 2 (2tt/) 



(1.236) 



Z(5(e i2 ^)) 



-arctan 



asin (2tt/) 
1 — acos (2irf) 



(1.237) 



No matter what value of a we choose, the above formulae clearly demonstrate the periodic 
nature of the spectra of discrete-time signals. Figure 1.105 shows indeed that the spectrum is a 
periodic function. We need only consider the spectrum between — | and | to unambiguously define 
it. When a > , we have a lowpass spectrum — the spectrum diminishes as frequency increases 
from to I — with increasing a leading to a greater low frequency content; for a < , we have a 
highpass spectrum (Figure 1.106). 



A|S(eJ 25tf )| 




Figure 1.105: The spectrum of the exponential signal (a — 0.5) is shown over the frequency range 
[—2, 2], clearly demonstrating the periodicity of all discrete-time spectra. The angle has units of degrees. 
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a = 0.9 



Figure 1.106: The spectra of several exponential signals are shown. What is the apparent relationship 
between the spectra for a — 0.5 and a — —0.5 ? 



Example 1.31 

Analogous to the analog pulse signal, let's find the spectrum of the length- N pulse sequence. 



s (n) 



1 if < n < N - 1 



(1.238) 



otherwise 
The Fourier transform of this sequence has the form of a truncated geometric series. 



N-l 



S (e 42 ^) = Y, e ~^ 



fn) 



(1.239) 



For the so-called finite geometric series, we know that 

Finite Geometric Series 

N+no-l , N 

En n„ 1_a 
a = a ° 
I- a 



(1.240) 



for all values of a . 

Exercise 1.8.4.1 (Solution on p. 142.) 

Derive this formula for the finite geometric series sum. The "trick" is to consider the difference 
between the series'; sum and the sum of the series multiplied by a . 

Applying this result yields (Figure 1.107.) 



S (e^f) 



l_ e -(i2x/) 

J-(iirf))(N-l) sin(7r/JV) 
sinO/) 



(1.241) 
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sin(iVx) 

sin(:r) 



which is known as the discrete-time sine 



The ratio of sine functions has the generic form of 

function, dsinc (x) . Thus, our transform can be concisely expressed as S (e* 271 '^) = e^^ 7r ^-'^ Ar ~ 1 ^dsinc (irf) 
. The discrete-time pulse's spectrum contains many ripples, the number of which increase with N , the 
pulse's duration. 
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Figure 1.107: The spectrum of a length-ten pulse is shown. Can you explain the rather complicated 
appearance of the phase? 



1.8.5 Discrete Fourier Transformation 109 

1.8.5.1 N-point Discrete Fourier Transform (DFT) 



N-l 



X [k] = Y^ x M e { - l) ^ kn \/k, k = {0, . . . , N - 1} : (jfe = {0, . . . , JV - 1}) 



n=0 
N-l 



M = ^ £ X W e ^ fc "Vn, n = {0, . . . , N - 1} : (» = {0, . . . , N - 1}) 



k=0 



(1.242) 
(1.243) 



Note that: 

• X [k] is the DTFT evaluated at u> = ^fcVfc, k = {0, . . . , N - 1} : (jfe = {0, . . . , N - 1}) 

• Zero-padding x [n] to M samples prior to the DFT yields an M-point uniform sampled version of the 
DTFT: 



N-l 



xUvA = Y j x[n], 



X-i)^k 



(1.244) 



109 This content is available online at <http://cnx.Org/content/ml0421/2.ll/>. 
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JV-l 



n=0 

X (e l v k \ = x zp [k] \fk, k = {0, . . . , M - 1} : (k = {0, . . . , M - 1}) 
• The JV-pt DFT is sufficient to reconstruct the entire DTFT of an JV-pt sequence: 

JV-l 

n=0 
JV-l JV-l 

X (e iw ) = J2 Jt J2 X W e^ kn ^-^ n 

n=0 k=0 

JV-l JV-l 

k=0 fe=0 

JV-l , / • fwJV-27rfc> 



X (e**) = X X [fc] 



-1 / ■ t uN-2nk \ 

1 / sin(— g— ) M)fa ,_ ¥fcV 



AT I s j n ^A f -27rfc \ ' 

/c=o \ fem l 2jv J 



(1.245) 




2pi/N 4pi/N 



Figure 1.108: Dirichlet sine 



' n -(f) 



• The DFT has a convenient matrix representation. Defining Wn 



=,(-*)¥ 



X[0] 
X[l] 



/ w% w% W° N w\ 



N yy N 



w% w l N W 2 N 



w% 



w% 



w A N 



N 

w 3 N 



x[0] 
x[l] 



V a: [jv-i] J \ \ \ \ \ \ J V x[n- i.j / 

where X = W (x) respectively. W has the following properties: 



(1.246) 
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W is Vandermonde: the nth column of W is a polynomial in WJ^ 
W is symmetric: W = W T 

}=W is unitary: ( 4^w) ( 4^w) = ( 4^w) ( 4^W 



VN 

w 



'N J \VN 

W' 1 , the IDFT matrix. 



>N 



'N 



For TV a power of 2, the FFT can be used to compute the DFT using about ^log 2 -/V rather than N 2 
operations. 



N 


flog 2 iV 


N 2 


16 


32 


256 


64 


192 


4096 


256 


1024 


65536 


1024 


5120 


1048576 



Table 1.6 



1.8.6 Discrete Fourier Transform (DFT) 110 

The discrete-time Fourier transform (and the continuous-time transform as well) can be evaluated when we 
have an analytic expression for the signal. Suppose we just have a signal, such as the speech signal used 
in the previous chapter, for which there is no formula. How then would you compute the spectrum? For 
example, how did we compute a spectrogram such as the one shown in the speech signal example 111 ? The 
Discrete Fourier Transform (DFT) allows the computation of spectra from discrete-time data. While in 
discrete-time we can exactly calculate spectra, for analog signals no similar exact spectrum computation 
exists. For analog-signal spectra, use must build special devices, which turn out in most cases to consist of 
A/D converters and discrete-time computations. Certainly discrete-time spectral analysis is more flexible 
than continuous-time spectral analysis. 

The formula for the DTFT 112 is a sum, which conceptually can be easily computed save for two issues. 

• Signal duration. The sum extends over the signal's duration, which must be finite to compute the 
signal's spectrum. It is exceedingly difficult to store an infinite-length signal in any case, so we'll 
assume that the signal extends over [0, N — 1]. 

• Continuous frequency. Subtler than the signal duration issue is the fact that the frequency variable 
is continuous: It may only need to span one period, like [— |, §] or [0, 1], but the DTFT formula as it 
stands requires evaluating the spectra at all frequencies within a period. Let's compute the spectrum 
at a few frequencies; the most obvious ones are the equally spaced ones / = -^, k € {0, . . . , K — 1}. 



We thus define the discrete Fourier transform (DFT) to be 



Vfc,fee {0,...,K-1}: \S(k) 



N-l 

Yl s ( n ) e 



(1.247) 



n=0 



J2TT-, 



Here, S (k) is shorthand for S I e 

We can compute the spectrum at as many equally spaced frequencies as we like. Note that you can think 
about this computationally motivated choice as sampling the spectrum; more about this interpretation later. 



110 This content is available online at <http://cnx.Org/content/ml0249/2.28/>. 

111 "Modeling the Speech Signal", Figure 5: spectrogram <http://cnx.Org/content/m0049/latest/#spectrogram> 

112 "Discrete-Time Fourier Transform (DTFT)", (1) <http://cnx.Org/content/ml0247/latest/#eqnl> 
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The issue now is how many frequencies are enough to capture how the spectrum changes with frequency. 
One way of answering this question is determining an inverse discrete Fourier transform formula: given S (k), 
k = {0, . . . , K — 1} how do we find s (n), n = {0, . . . , N — 1}? Presumably, the formula will be of the form 
s i n ) = J2k=o & W e K ■ Substituting the DFT formula in this prototype inverse transform yields 

K-\ JV-1 

s (n) = V V s (m) e -l'TrJ e 'T (1.248) 

fc=0 m=0 

Note that the orthogonality relation we use so often has a different character now. 



,v_1 ,. ., ' K if (m = {n,n±K,n±2K,...\) 

^ e -^-R-) e ^-K- = < _ , . (1-249) 

fc=0 



otherwise 



We obtain nonzero value whenever the two indices differ by multiples of K. We can express this result as 
K J2i S (m — n — IK). Thus, our formula becomes 



N-l oo 

s(n)= J2 s(m)K ^ S(m-n-lK) (1.250) 

m— / — — oo 

The integers n and to both range over {0, . . . ,N — 1}. To have an inverse transform, we need the sum 
to be a single unit sample for m, n in this range. If it did not, then s (n) would equal a sum of values, 
and we would not have a valid transform: Once going into the frequency domain, we could not get back 
unambiguously! Clearly, the term I = always provides a unit sample (we'll take care of the factor of K 
soon). If we evaluate the spectrum at fewer frequencies than the signal's duration, the term corresponding 
to to = n + K will also appear for some values of to, n = {0, . . . , N — 1}. This situation means that our 
prototype transform equals s (n) + s (n + K) for some values of n. The only way to eliminate this problem 
is to require K > N: We must have at least as many frequency samples as the signal's duration. In this 
way, we can return from the frequency domain we entered via the DFT. 

Exercise 1.8.6.1 (Solution on p. 142.) 

When we have fewer frequency samples than the signal's duration, some discrete-time signal values 
equal the sum of the original signal values. Given the sampling interpretation of the spectrum, 
characterize this effect a different way. 

Another way to understand this requirement is to use the theory of linear equations. If we write out the 
expression for the DFT as a set of linear equations, 

s (0) + s (1) + • • • + s {N - 1) = 5 (0) (1.251) 

s (0) + s (1) e (-i) ^ + • • • + a (N - 1) e^ 2 -^ 11 = S (1) 



a (0) + s (1) e^^^T^- + • • • + s (N - 1) e< -, > « = S {K - 1) 

we have K equations in N unknowns if we want to find the signal from its sampled spectrum. This require- 
ment is impossible to fulfill if K < N; we must have K > N. Our orthogonality relation essentially says that 
if we have a sufficient number of equations (frequency samples), the resulting set of equations can indeed be 
solved. 

By convention, the number of DFT frequency values K is chosen to equal the signal's duration N. The 
discrete Fourier transform pair consists of 
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Discrete Fourier Transform Pair 



S(*) = £"=o*(«)e-W) 



(1.252) 



Example 1.32 

Use this demonstration to perform DFT analysis of a signal. 

This media object is a Lab VIEW VI. Please view or download it at 
<DFTanalysis.llb> 

Example 1.33 

Use this demonstration to synthesize a signal from a DFT sequence. 
This media object is a Lab VIEW VI. Please view or download it at 
<DFT_Component_Manipulation.llb> 



1.8.7 Common Fourier Transforms 113 

1.8.7.1 Common CTFT Properties 



Time Domain Signal 


Frequency Domain Signal 


Condition 


e-( at lu{t) 


l 


a> 


e at u{-t) 


1 
a— iui 


a> 


e -(o|*l) 


2a 


a> 


a 2 +cj 2 


te~^u{t) 


1 


a> 


(a+icj) 2 


t n e -{at) u (fi 


n! 


a> 


(a+iui) n + 1 


S(t) 


1 




1 


2ir5 (w) 




piuj t 


2tt5 (u — u>o) 




cos (coot) 


■k (S (u> - LJo) + 5 (u + Wo)) 




sin (u>ot) 


in (S (u> + u) ) — 5 (lu — coo)) 




u(t) 


7T<5 (w) + - 




sgn (t) 


_2_ 

iuj 




cos (u>ot) u (t) 


§ (6 (w - w ) + 6 (w + w )) + 




U>Q 2 —UJ 2 


continued on next page 



113 This content is available online at <http://cnx.Org/content/ml0099/2.ll/>. 
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sin (Dot) u (t) 


§(<5(cj-cj )-<5(^ + u;o)) + 

wo 




UJq 2 — id 2 


e - (^) sin (Dot) u(t) 


Wo 


a> 


(a+iw) 2 +w 2 


e~( a *) cos (D t)u(t) 


a-Hcj 


a> 


(a+iuj) 2 +ljq 2 


u(t + r) -u(t- t) 


2r sin(wr) _ 2Ts . nc ^ 




m — -^r 2 - = —sine Wn 


u (d + Do) — u(d — do) 




(± + l)(„(± + l)-„(±)) + 
triag(£) 


rsinc 2 (^) 




^sinc 2 (^) 


U+i)(«U +1 )-H-)) + 

(- — + l) (u (^-) - u ( ^- - lV = 

tria s(^) 


E~_oo*(*-»r) 


^0 E^-oo 5 ( w - nuJ o) 


WO — ~r 


e 2a 2 


, <T 2 ^ 2 

fiv27re 2 





Table 1.7 

triag[n] is the triangle function for arbitrary real- valued n. 

1 + n if - 1 < n < 
triag[n] ={l_ n if < n < 1 
otherwise 

1,8.8 Linear Constant Coefficient Difference Equations 114 

1.8.8.1 Introduction: Difference Equations 

In our study of signals and systems, it will often be useful to describe systems using equations involving 
the rate of change in some quantity. In discrete time, this is modeled through difference equations, which 
are a specific type of recurrance relation. For instance, recall that the funds in an account with discretely 
componded interest rate r will increase by r times the previous balance. Thus, a discretely compounded 
interest system is described by the first order difference equation shown in (1.253). 



y(n) = (l + r)y(n- 1) 



(1.253) 



Given a sufficiently descriptive set of initial conditions or boundary conditions, if there is a solution to the 
difference equation, that solution is unique and describes the behavior of the system. Of course, the results 
are only accurate to the degree that the model mirrors reality. 

1.8.8.2 Linear Constant Coefficient Difference Equations 

An important subclass of difference equations is the set of linear constant coefficient difference equations. 
These equations are of the form 



Cy(n) = f(n) 



(1.254) 



4 This content is available online at <http://cnx.Org/content/ml2325/l.4/>. 
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where C is a difference operator of the form given 

C = c N D N + CN-iD 1 *- 1 + ... + Cl D + c (1.255) 

in which D is the first difference operator 

D(y(n)) = y(n)-y(n-l). (1.256) 

Note that operators of this type satisfy the linearity conditions, and Co, •■•, c„ are real constants. 

However, (1.254) can easily be written as a linear constant coefficient recurrence equation without differ- 
ence operators. Conversely, linear constant coefficient recurrence equations can also be written in the form 
of a difference equation, so the two types of equations are different representations of the same relationship. 
Although we will still call them linear constant coefficient difference equations in this course, we typically 
will not write them using difference operators. Instead, we will write them in the simpler recurrence relation 
form 

N M 

^a k y(n- k) = ^b k x(n- k) (1.257) 

k=0 fe=0 

where x is the input to the system and y is the output. This can be rearranged to find y (n) as 

I ( N M \ 

V (n) = — \-^a k y (n - k) + ^ h * x {n-k)\ (1.258) 

fl ° V fc=l k=0 ) 

The forms provided by (1.257) and (1.258) will be used in the remainder of this course. 

A similar concept for continuous time setting, differential equations, is discussed in the chapter on time 
domain analysis of continuous time systems. There are many parallels between the discussion of linear 
constant coefficient ordinary differential equations and linear constant coefficient differece equations. 

1.8.8.3 Applications of Difference Equations 

Difference equations can be used to describe many useful digital filters as described in the chapter discussing 
the z-transform. An additional illustrative example is provided here. 

Example 1.34 

Recall that the Fibonacci sequence describes a (very unrealistic) model of what happens when a 
pair rabbits get left alone in a black box... The assumptions are that a pair of rabits never die 
and produce a pair of offspring every month starting on their second month of life. This system is 
defined by the recursion relation for the number of rabit pairs y (n) at month n 

y(n) = y(n-l) + y(n-2) (1.259) 

with the initial conditions y (0) = and y (1) = 1. The result is a very fast growth in the sequence. 
This is why we do not open black boxes. 



1.8.8.4 Linear Constant Coefficient Difference Equations Summary 

Difference equations are an important mathematical tool for modeling discrete time systems. An important 
subclass of these is the class of linear constant coefficient difference equations. Linear constant coefficient 
difference equations are often particularly easy to solve as will be described in the module on solutions to 
linear constant coefficient difference equations and are useful in describing a wide range of situations that 
arise in electrical engineering and in other fields. 
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1.8.9 Solving Linear Constant Coefficient Difference Equations 115 

1.8.9.1 Introduction 

The approach to solving linear constant coefficient difference equations is to find the general form of all 
possible solutions to the equation and then apply a number of conditions to find the appropriate solution. 
The two main types of problems are initial value problems, which involve constraints on the solution at several 
consecutive points, and boundary value problems, which involve constraints on the solution at nonconsecutive 
points. 

The number of initial conditions needed for an TVth order difference equation, which is the order of the 
highest order difference or the largest delay parameter of the output in the equation, is N, and a unique 
solution is always guaranteed if these are supplied. Boundary value probelms can be slightly more complicated 
and will not necessarily have a unique solution or even a solution at all for a given set of conditions. Thus, 
this section will focus exclusively on initial value problems. 

1.8.9.2 Solving Linear Constant Coefficient Difference Equations 

Consider some linear constant coefficient difference equation given by Ay (n) = f(n), in which A is a 
difference operator of the form 

A = a N D N + cln^D*- 1 + ... + a x D + a (1.260) 

where D is the first difference operator 

D(y(n)) = y(n)-y(n-l). (1.261) 

Let yhin) and y p (n) be two functions such that Ay^ (n) = and Ay p (n) = f (n). By the linearity of 
A, note that L (yh (n) + y v (n)) = + / (n) = f (n). Thus, the form of the general solution y g (n) to any 
linear constant coefficient ordinary differential equation is the sum of a homogeneous solution yh (n) to the 
equation Ay (n) = and a particular solution y p (n) that is specific to the forcing function / (n). 

We wish to determine the forms of the homogeneous and nonhomogeneous solutions in full generality in 
order to avoid incorrectly restricting the form of the solution before applying any conditions. Otherwise, a 
valid set of initial or boundary conditions might appear to have no corresponding solution trajectory. The 
following sections discuss how to accomplish this for linear constant coefficient difference equations. 

1.8.9.2.1 Finding the Homogeneous Solution 

In order to find the homogeneous solution to a difference equation described by the recurrence relation 
J2k=o a kV ( n ~~ k) = f (n), consider the difference equation J2k=o afe ^ (n — k) = 0. We know that the solu- 
tions have the form c\ n for some complex constants c, A. Since J2k=o a kc\ n ~ k = for a solution it follows 
that 

N 

c X n ' N J2a k X N ' k = (1-262) 

fe=0 

so it also follows that 

a X N + ... + a N = 0. (1.263) 

Therefore, the solution exponential are the roots of the above polynomial, called the characteristic polyno- 
mial. 



115 This content is available online at <http://cnx.Org/content/ml2326/l.5/>. 
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For equations of order two or more, there will be several roots. If all of the roots are distinct, then the 
general form of the homogeneous solution is simply 

y h (n) = c 1 X r ? + ... + c 2 X%. (1.264) 

If a root has multiplicity that is greater than one, the repeated solutions must be multiplied by each power 
of n from to one less than the root multipicity (in order to ensure linearly independent solutions). For 
instance, if Ai had a multiplicity of 2 and A2 had multiplicity 3, the homogeneous solution would be 

Vh ( n ) = ciA™ + c 2 nA™ + c 3 X r ^ + c^nX 2 + c 5 n 2 X^. (1.265) 

Example 1.35 

Recall that the Fibonacci sequence describes a (very unrealistic) model of what happens when a 
pair rabbits get left alone in a black box... The assumptions are that a pair of rabits never die 
and produce a pair of offspring every month starting on their second month of life. This system is 
defined by the recursion relation for the number of rabit pairs y (n) at month n 

y{n) - y{n- 1) - y (n - 2) = (1.266) 

with the initial conditions y (0) = and y (1) = 1. 

Note that the forcing function is zero, so only the homogenous solution is needed. It is easy to 
see that the characteristic polynomial is A 2 — A — 1 = 0, so there are two roots with multiplicity 
one. These are Ai = 1+ 2 and A2 = 1 2 5 - Thus, the solution is of the form 

S W = c,(i±^)" + c 2 (i^)" (1.267, 

Using the initial conditions, we determine that 

(1.268) 



(1.269) 



C\ = 


5 




and 






C2 = " 


V5 
5 




Hence, the Fibonacci sequence is given by 






V{n)= 5 2; 


f-£( 


'l-v/5 



(1.270) 



1.8.9.2.2 Finding the Particular Solution 

Finding the particular solution is a slightly more complicated task than finding the homogeneous solution. It 
can be found through convolution of the input with the unit impulse response once the unit impulse response 
is known. Finding the particular solution ot a differential equation is discussed further in the chapter 
concerning the z-transform, which greatly simplifies the procedure for solving linear constant coefficient 
differential equations using frequency domain tools. 
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Example 1.36 

Consider the following difference equation describing a system with feedback 

y (n) — ay (n — 1) = x (n) . (1.271) 

In order to find the homogeneous solution, consider the difference equation 

y(n)-ay(n-l) = 0. (1.272) 

It is easy to see that the characteristic polynomial is A — a = 0, so A = a is the only root. Thus 
the homogeneous solution is of the form 

y h (n) = cio". (1.273) 

In order to find the particular solution, consider the output for the x (n) = 5 (n) unit impulse case 

y{n) -ay{n-l) = 5{n) . (1.274) 

By inspection, it is clear that the impulse response is a n u (n). Hence, the particular solution for a 
given x (n) is 

y p (n)=x(n)*(a n u(n)). (1.275) 

Therefore, the general solution is 

V g (n) = yn (n) + y p (n) = cio™ + x (n) * (a n u (n)) . (1.276) 

Initial conditions and a specific input can further tailor this solution to a specific situation. 



1.8.9.3 Solving Difference Equations Summary 

Linear constant coefficient difference equations are useful for modeling a wide variety of discrete time systems. 
The approach to solving them is to find the general form of all possible solutions to the equation and then 
apply a number of conditions to find the appropriate solution. This is done by finding the homogeneous 
solution to the difference equation that does not depend on the forcing function input and a particular 
solution to the difference equation that does depend on the forcing function input. 
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1.9 Viewing Embedded Lab VIEW Content 116 

In order to view Lab VIEW content embedded in Connexions modules, you must install the Lab VIEW Run- 
time Engine on your computer. The following are sets of instructions for installing the software on different 
platforms. 

note: Embedded Lab VIEW content is currently supported only under Windows 2000/XP. Also, 
you must have version 8.0.1 of the Lab View Run-time Engine to run much of the embedded content 
in Connexions. 



116 This content is available online at <http://cnx.Org/content/ml3753/l.3/>. 
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1.9.1 Installing the LabVIEW Run-time Engine on Microsoft Windows 2000/XP 

1. Point your web browser to the LabVIEW Run-time Engine download page at: 
http://digital.ni.com/softlib.nsf/websearch/077b51e8dl5604bd8625711c006240e7 117 . 

2. If you're not logged in to NI, click the link to continue the download process at the bottom of the page. 

3. Login or create a profile with NI to continue. 

4. Once logged in, click the LabVIEW_8 . . l_Runtime_Engine.exe link and save the file to disk. 

5. Once the file has downloaded, double click it and follow the steps to install the run-time engine. 

6. Download the LabVIEW Browser Plug-in at: http://zone.ni.com/devzone/conceptd.nsf/webmain/7DBFD404C6AD0Bz 

7. Put the LVBrowserPlugin.ini file in the My Documents\LabVIEW Data folder. (You may have to 
create this folder if it doesn't already exist.) 

8. Restart your web browser to complete the installation of the plug-in. 



117 http://digital.ni.com/softlib.nsf/websearch/077b51e8dl5604bd8625711c006240e7 
118 http://zone.ni.com/devzone/conceptd.nsf/webmain/7DBFD404C6AD0B24862570BB0072F83B/$FILE/LVBrowserPlugin.ini 
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Solutions to Exercises in Chapter 1 



Solution to Exercise 1.4.2.1 (p. 41) 

Because of Euler's relation, 

sin (2tt ft) = -e l27r/ * - L e -(^ft) (1.277) 

K J ' 2i 2i y ' 

Thus, c\ = j7, c_i = — j7, and the other coefficients are zero. 
Solution to Exercise 1.4.2.2 (p. 44) 

Co = 4p. This quantity clearly corresponds to the periodic pulse signal's average value. 
Solution to Exercise 1.4.3.1 (p. 45) 

Write the coefficients of the complex Fourier series in Cartesian form as c k = A/, + iB^ and substitute into 
the expression for the complex Fourier series. 

00 00 

2jvkt X — ^ / . ^ \ i 2-jvkt 



c k e l T = 2^ {A k + iB k )e l t 



k— — co k — — oc- 

Simplifying each term in the sum using Euler's formula, 

(A k + iB k ) J™ = (A k + iB k ) (cos (^) + ism(^)) 

= A k cos (*&) - B kS in (^M) + i (A k sin (*&) + B k cos (*&)) 

We now combine terms that have the same frequency index in magnitude. Because the signal is real- 
valued, the coefficients of the complex Fourier series have conjugate symmetry: c- k = c^ or A- k = A k and 
£>_fc = — B k . After we add the positive-indexed and negative-indexed terms, each term in the Fourier series 
becomes 2vlfeCos (^^) — 2B/ C sin (^^). To obtain the classic Fourier series (1.97), we must have 2A k = a k 
and 2B k = -b k . 
Solution to Exercise 1.4.3.2 (p. 46) 

The average of a set of numbers is the sum divided by the number of terms. Viewing signal integration as 
the limit of a Riemann sum, the integral corresponds to the average. 
Solution to Exercise 1.4.3.3 (p. 46) 

We found that the complex Fourier series coefficients are given by c k = -Ar. The coefficients are pure 
imaginary, which means a k = 0. The coefficients of the sine terms are given by b k = — (29 {c k j) so that 



b 



k 



4 if k odd 
if k even 



Thus, the Fourier series for the square wave is 



fce{i,3,...} x / 

Solution to Exercise 1.4.4.1 (p. 48) 

The rms value of a sinusoid equals its amplitude divided by V22- As a half-wave rectified sine wave is zero 
during half of the period, its rms value is ^ since the integral of the squared half-wave rectified sine wave 
equals half that of a squared sinusoid. 
Solution to Exercise 1.4.4.2 (p. 49) 

\poc 2 , . 2 

Total harmonic distortion equals = 2 2 A 2 k ■ Clearly, this quantity is most easily computed in the fre- 
quency domain. However, the numerator equals the square of the signal's rms value minus the power in the 
average and the power in the first harmonic. 
Solution to Exercise 1.4.5.1 (p. 52) 

Total harmonic distortion in the square wave is 1 — |(— ) = 20%. 
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Solution to Exercise 1.4.6.1 (p. 55) 

N signals directly encoded require a bandwidth of £;■ Using a binary representation, we need -^ — . For 
N = 128, the binary-encoding scheme has a factor of y|g = 0.05 smaller bandwidth. Clearly, binary encoding 
is superior. 
Solution to Exercise 1.4.6.2 (p. 55) 

We can use N different amplitude values at only one frequency to represent the various letters. 
Solution to Exercise 1.4.7.1 (p. 58) 

Because the filter's gain at zero frequency equals one, the average output values equal the respective average 
input values. 
Solution to Exercise 1.4.8.1 (p. 60) 

/oo />oo 

S (/) e-^Mdf = S(f) e^H-Vdf = s (-t) 

-oo J — oo 

Solution to Exercise 1.4.8.2 (p. 60) 

T{T{T{T{ S {t))))) = 8 (t). We know that F(S(f)) = J^S {f)e~^^df = /^ S (/) e* 2 ^-*)^ = 
s{—t). Therefore, two Fourier transforms applied to s (t) yields s(—t). We need two more to get us back 
where we started. 
Solution to Exercise 1.4.8.3 (p. 62) 

The signal is the inverse Fourier transform of the triangularly shaped spectrum, and equals s (t) = 



(sin( 



;Wt) \ 2 



Solution to Exercise 1.4.8.4 (p. 63) 

The result is most easily found in the spectrum's formula: the power in the signal-related part of x (t) is 
half the power of the signal s (t). 
Solution to Exercise 1.4.9.1 (p. 64) 

The inverse transform of the frequency response is ^e"wii(f). Multiplying the frequency response by 
1 — e~(* 27r ^ A ) means subtract from the original signal its time-delayed version. Delaying the frequency 

1 -(t- A) 

response's time-domain version by A results in -^e ro u(t — A). Subtracting from the undelayed signal 

yields -^Ue«cu (£)— -^Ue «c u(t — A). Now we integrate this sum. Because the integral of a sum equals the 
sum of the component integrals (integration is linear), we can consider each separately. Because integration 
and signal-delay are linear, the integral of a delayed signal equals the delayed version of the integral. The 
integral is provided in the example (1.130). 
Solution to Exercise 1.5.1.1 (p. 82) 

In order to calculate the Fourier transform, all we need to use is (1.138) (Continuous-Time Fourier Trans- 
form), complex exponentials (Section 1.1.5), and basic calculus. 

Jo (1.279) 







a-\-iQ 



a + til 



Solution to Exercise 1.5.1.2 (p. 82) 

Here we will use (1.139) (Inverse CTFT) to find the inverse FT given that t =/= 0. 



= £e'< n '*>| n ,n= e <» (1-281) 

= ^sin(Mi) 
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, s M ( Mt\ 
x (t) = — sine (1.282) 

IT \ IT J 

Solution to Exercise 1.7.1.1 (p. 101) 

The indices can be negative, and this condition is not allowed in MATLAB. To fix it, we must start the 
signals later in the array. 
Solution to Exercise 1.7.1.2 (p. 103) 

Such terms would require the system to know what future input or output values would be before the 
current value was computed. Thus, such terms can cause difficulties. 
Solution to Exercise 1.7.3.1 (p. 116) 

undefined k = 

a-k = { lS m 3 fffel 

i — -, — ^w- 1 otherwise 
8 £fc 3 



Solution to Exercise 1.8.4.1 (p. 127) 



JV+n -l N+no-1 



a V a" - V a n = a N+n '< - a n ° (1.283) 



Z^ " Z^ 

-no n—no 



which, after manipulation, yields the geometric sum formula. 
Solution to Exercise 1.8.6.1 (p. 131) 

This situation amounts to aliasing in the time-domain. 
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